-- Logs begin at Thu 2022-06-16 22:06:47 UTC, end at Thu 2022-06-16 23:18:23 UTC. -- Jun 16 22:52:08.428116 dv-cinder-846230-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 16 22:52:08.438318 dv-cinder-846230-1-iscsi devstack@n-api.service[103022]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 16 22:52:08.440721 dv-cinder-846230-1-iscsi devstack@n-api.service[103022]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jun 16 22:52:08 2022] *** Jun 16 22:52:08.440721 dv-cinder-846230-1-iscsi devstack@n-api.service[103022]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 16 22:52:08.440721 dv-cinder-846230-1-iscsi devstack@n-api.service[103022]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 16 22:52:08.440721 dv-cinder-846230-1-iscsi devstack@n-api.service[103022]: nodename: dv-cinder-846230-1-iscsi Jun 16 22:52:08.440721 dv-cinder-846230-1-iscsi devstack@n-api.service[103022]: machine: x86_64 Jun 16 22:52:08.440721 dv-cinder-846230-1-iscsi devstack@n-api.service[103022]: clock source: unix Jun 16 22:52:08.440721 dv-cinder-846230-1-iscsi devstack@n-api.service[103022]: pcre jit disabled Jun 16 22:52:08.440721 dv-cinder-846230-1-iscsi devstack@n-api.service[103022]: detected number of CPU cores: 4 Jun 16 22:52:08.440721 dv-cinder-846230-1-iscsi devstack@n-api.service[103022]: current working directory: / Jun 16 22:52:08.440721 dv-cinder-846230-1-iscsi devstack@n-api.service[103022]: detected binary path: /usr/bin/uwsgi-core Jun 16 22:52:08.441387 dv-cinder-846230-1-iscsi devstack@n-api.service[103022]: your processes number limit is 47680 Jun 16 22:52:08.441387 dv-cinder-846230-1-iscsi devstack@n-api.service[103022]: your memory page size is 4096 bytes Jun 16 22:52:08.441387 dv-cinder-846230-1-iscsi devstack@n-api.service[103022]: detected max file descriptor number: 2048 Jun 16 22:52:08.441387 dv-cinder-846230-1-iscsi devstack@n-api.service[103022]: lock engine: pthread robust mutexes Jun 16 22:52:08.441387 dv-cinder-846230-1-iscsi devstack@n-api.service[103022]: thunder lock: enabled Jun 16 22:52:08.441387 dv-cinder-846230-1-iscsi devstack@n-api.service[103022]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 16 22:52:08.441387 dv-cinder-846230-1-iscsi devstack@n-api.service[103022]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 16 22:52:08.493403 dv-cinder-846230-1-iscsi devstack@n-api.service[103022]: Python main interpreter initialized at 0x5622de9839c0 Jun 16 22:52:08.493403 dv-cinder-846230-1-iscsi devstack@n-api.service[103022]: python threads support enabled Jun 16 22:52:08.493403 dv-cinder-846230-1-iscsi devstack@n-api.service[103022]: your server socket listen backlog is limited to 100 connections Jun 16 22:52:08.493403 dv-cinder-846230-1-iscsi devstack@n-api.service[103022]: your mercy for graceful operations on workers is 90 seconds Jun 16 22:52:08.493770 dv-cinder-846230-1-iscsi devstack@n-api.service[103022]: mapped 403077 bytes (393 KB) for 2 cores Jun 16 22:52:08.493770 dv-cinder-846230-1-iscsi devstack@n-api.service[103022]: *** Operational MODE: preforking *** Jun 16 22:52:08.494019 dv-cinder-846230-1-iscsi devstack@n-api.service[103022]: *** uWSGI is running in multiple interpreter mode *** Jun 16 22:52:08.494019 dv-cinder-846230-1-iscsi devstack@n-api.service[103022]: spawned uWSGI master process (pid: 103022) Jun 16 22:52:08.494220 dv-cinder-846230-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 16 22:52:08.495594 dv-cinder-846230-1-iscsi devstack@n-api.service[103022]: spawned uWSGI worker 1 (pid: 103023, cores: 1) Jun 16 22:52:08.495594 dv-cinder-846230-1-iscsi devstack@n-api.service[103022]: spawned uWSGI worker 2 (pid: 103024, cores: 1) Jun 16 22:52:08.495775 dv-cinder-846230-1-iscsi devstack@n-api.service[103022]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 16 22:52:09.151206 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 16 22:52:09.151797 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 16 22:52:10.318715 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 22:52:10.318715 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: from cryptography.utils import int_from_bytes Jun 16 22:52:10.319315 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 22:52:10.319315 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: from cryptography.utils import int_from_bytes Jun 16 22:52:10.324316 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 22:52:10.324316 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: from cryptography.utils import int_from_bytes Jun 16 22:52:10.324731 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 22:52:10.324731 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: from cryptography.utils import int_from_bytes Jun 16 22:52:12.874810 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 16 22:52:12.875472 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 16 22:52:12.875569 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 16 22:52:12.875932 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 16 22:52:12.876194 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 16 22:52:12.876587 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.876916 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.877240 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.877565 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.877902 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.878222 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.878544 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.878890 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.879065 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 16 22:52:12.879440 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.879523 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 16 22:52:12.879598 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.879773 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.879883 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 16 22:52:12.880097 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-846230-1-iscsi {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.880189 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 16 22:52:12.880414 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 16 22:52:12.880521 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.880719 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.880850 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.881029 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.881113 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.881349 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.881431 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.881655 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.881746 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.881978 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.882072 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.882285 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.882375 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.883233 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.883327 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.883556 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.883787 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.883891 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.884098 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.884205 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.884412 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.884503 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.884738 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-846230-1-iscsi {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.884836 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.885054 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.885151 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.885353 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.885447 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.885662 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.885749 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.885970 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.886055 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.886269 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.886375 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.886600 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.886705 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.886912 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.886996 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-846230-1-iscsi {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.887314 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.887409 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.887631 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.887767 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.887947 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.888036 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.888297 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.888399 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.888629 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.888717 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.888943 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.889034 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.889249 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.889334 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.889566 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.889648 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.889872 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.889958 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.890190 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.890363 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.890503 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.890636 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.890852 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.890936 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-846230-1-iscsi {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.891176 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.891269 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.891482 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.891568 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.891794 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.891879 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.892104 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.892198 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.892423 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.892509 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.892728 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.892820 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.893033 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.893126 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.893284 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.893374 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.893594 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.893689 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.893917 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.894009 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.894239 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.894329 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.894561 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.894678 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.894839 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.894937 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.895092 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.895209 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.895413 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.895517 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.895738 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.895825 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.896049 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.896133 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.896365 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.896476 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.896674 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.896780 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.896935 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.897280 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.897491 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.897585 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.897809 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.897904 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.898150 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.898250 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.898461 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.898565 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.898803 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.898898 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.899052 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.899139 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.899371 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.899473 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.899689 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.899791 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.899997 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.900091 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.900305 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.900400 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.17 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.900615 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.900711 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.17 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.900921 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.901007 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.901227 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.901314 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.901534 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.901629 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.901837 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.901929 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.902141 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.902227 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.902458 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.902544 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.902795 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.902882 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.903103 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.903190 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.903410 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.903495 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.903728 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.903827 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.904063 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.904149 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.17 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.904353 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.17 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.904438 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.904606 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.904700 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.904909 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.904994 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.905216 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.905302 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.905536 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.905630 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.905843 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.905929 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.906151 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.906238 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.906459 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.906554 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.906786 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.906874 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.907092 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.907190 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.907398 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.907484 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.907706 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.907792 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.908018 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.908117 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.908269 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.908391 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.908568 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.908654 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.908872 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.908957 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.909188 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.909284 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.909490 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.909581 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.909792 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.909877 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.910099 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.910195 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.910401 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.910486 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.910727 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.910815 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.911031 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.911116 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.911334 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.911431 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.911635 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.911719 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.911939 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.912024 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.912240 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.912324 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.912543 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.912627 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.912845 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.912930 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.913147 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.913243 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.913462 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.913555 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.913792 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.913880 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.914100 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.914195 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.914399 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.914492 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.914725 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.914823 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.915029 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.915122 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.915344 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.915437 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.915647 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.915738 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.915950 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.916041 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.916253 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.916414 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.916553 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.916638 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.916854 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.916947 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.917160 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.917258 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.917461 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.917544 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.917761 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.917845 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.918067 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.918163 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.918360 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.918489 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.918688 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.918791 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.919004 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.919090 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.919309 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.919399 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.919607 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.919690 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.919907 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.919993 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.920206 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.920292 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.920513 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.920596 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.920815 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.920902 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.921113 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.921204 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.921413 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.921496 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.921708 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.921822 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.922023 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.922143 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.922341 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.922459 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.922678 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.922801 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.922987 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.923130 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.923291 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.923446 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.923605 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:52:12.923759 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.923936 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.924072 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.924267 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.924391 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.924607 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.924711 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.924918 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.925040 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.925245 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.925360 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.925574 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.925664 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.925888 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.925972 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.926197 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.926290 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.926509 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.926651 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.926856 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.926953 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.927168 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.927254 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.927479 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.927570 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.927790 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.927882 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.928105 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.928198 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.928420 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.928539 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.928748 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.928832 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.929064 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.929150 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.929948 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.930039 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.930265 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.930347 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.930572 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.930684 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.930919 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.931002 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.931246 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.931343 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.931566 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.931650 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.931876 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.931959 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.932216 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.932307 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.932529 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.932621 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.932842 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.932933 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.933155 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.933248 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.933468 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.933553 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.933776 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.933858 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.934086 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.934180 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.934396 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.934488 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.934739 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.934826 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.935061 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.935147 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.935370 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.935452 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.935682 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.935771 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.935992 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.936076 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.936297 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.936386 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.936604 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.936689 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.936911 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.936996 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.937216 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.937299 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.937520 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.937602 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.937843 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.937928 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.938155 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.938238 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.938466 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.938548 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.938811 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.938897 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.939121 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.939207 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.939431 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.939598 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.939742 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.939826 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.940046 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.940138 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.940349 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.940505 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.940636 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.940764 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.940950 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.941079 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.941252 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.941393 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.941568 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.941697 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.941879 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.942006 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.942186 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.942323 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.942508 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.942681 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.942837 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.942972 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.943144 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.943275 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.943451 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.943582 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.943759 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.943891 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.944064 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.944196 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.944375 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.944523 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.944682 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.944814 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.945047 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.945696 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.945875 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.946015 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.946188 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.946327 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.946494 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.946650 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.946844 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.947003 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.947152 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.947298 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.947441 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.947579 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.947758 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.947886 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.948067 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.948205 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.948378 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.948508 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.948689 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.948840 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.948991 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.949134 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.949275 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.949409 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.949579 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.949707 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.949891 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.950026 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.950195 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.950323 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.950502 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.950684 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.950824 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.950971 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.951126 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.951214 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.951432 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.951516 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.951755 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.951842 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.952066 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.952150 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.952372 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.952464 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.952675 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.952760 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.952976 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.953059 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.953278 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.953362 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.953585 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.953679 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.953885 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.953977 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.954187 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.954321 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.954636 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.954725 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.954946 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.955030 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.955250 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.955349 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.955570 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.955662 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.955877 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.955963 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.956178 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.956281 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.956482 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.956568 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.956782 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.956868 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.957102 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.957198 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.957415 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.957505 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.957734 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.957819 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.958046 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.958221 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.958370 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.958567 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.958717 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.958936 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.959033 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.959251 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.959343 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.959634 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.959718 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.959974 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.960067 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.960309 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.960400 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.960664 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.960755 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.960991 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.961088 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.961304 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.961390 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.961621 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.961704 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.961930 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.962022 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.962241 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.962332 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.962550 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.962694 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.962887 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.962981 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.963205 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.963288 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.963510 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.963595 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.963826 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.963912 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.964135 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.964218 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.964458 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.964542 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.964769 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.964855 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.965088 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.965172 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.965392 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.965477 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.965703 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.965787 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.966012 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.966097 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.966322 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.966415 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.966653 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.966743 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.966967 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.967063 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.967287 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.967385 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.967597 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.967687 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.967908 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.967992 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.968212 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.968304 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.968523 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.968605 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.968829 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.968919 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.969138 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.969303 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.969438 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.969522 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.969750 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.969834 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.970059 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.970152 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.970367 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.970451 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.970711 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.970798 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.971021 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.971107 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.971327 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.971419 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.971632 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.971716 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.971936 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.972020 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.972247 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.972341 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.972551 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.972636 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.972856 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.972942 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.973164 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.973255 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.973466 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.973549 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.973771 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.973864 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.974077 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.974161 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.974381 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.974475 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.974712 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.974800 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.975017 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.975100 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.975319 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.975416 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.975618 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.975744 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.975927 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.976011 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.976282 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.976383 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.976592 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.976677 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.976909 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.976992 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.977227 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.977321 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.977533 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.977618 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.977835 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.977919 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.978145 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.978237 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.978450 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.978534 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.978778 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.978883 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.979084 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.979186 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.979383 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.979468 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.979702 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.979793 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.980014 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.980100 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.980312 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.980397 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.980634 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.980744 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.980933 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.981022 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.981242 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.981325 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.981550 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.981641 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.981857 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.981941 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.982163 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.982246 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.982480 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.982676 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.982818 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.983127 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.983240 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.983434 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.983579 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.983750 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.983898 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.984048 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.984221 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.984354 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.984544 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.984674 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.984873 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.984992 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.985204 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.985304 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.985534 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.985632 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.985853 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.985949 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.986162 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.986267 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.986469 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.986572 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.986803 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.987051 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.987145 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.987382 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.987476 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.987697 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.987792 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.988002 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.988095 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.988309 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.988414 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.988640 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.988739 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.988921 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.989016 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.989229 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.989335 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.989531 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.989628 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.989836 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.989932 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.990153 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.990239 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.990453 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.990547 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.990788 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.990900 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.991094 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.991193 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.991406 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.991499 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.991696 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.991802 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.992541 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.992627 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.992850 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.992938 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.993149 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.993242 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.993453 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.993540 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.993754 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.993842 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.994055 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.994142 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.994364 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.994450 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.994689 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.994780 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.995000 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.995087 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.995301 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.995396 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.995620 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.995708 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.995928 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.996013 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.996230 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.996324 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.996533 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.996617 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.996831 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.996915 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.997144 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.997251 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.997480 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.997572 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.997754 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.997847 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.998061 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.998162 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.998372 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.998458 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.998704 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.998793 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.999015 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.999110 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.999328 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.999437 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.999628 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.999721 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:12.999927 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.000069 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.000226 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.000362 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.000529 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.000663 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.000830 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.000972 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.001125 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.001256 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.001428 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.001516 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.001727 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.001814 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.002029 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.002115 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.002336 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.002519 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.002688 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.002774 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.002961 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.003086 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.003265 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.003398 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.003569 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.003713 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.003879 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.004039 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.004255 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.004452 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.004552 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.004767 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.004896 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.005081 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.005166 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.005386 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.005474 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.005685 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.005771 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.005992 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.006076 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.006290 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.006377 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.006606 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.006694 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.006917 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.007017 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.007220 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.007306 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.007585 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.007679 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.007895 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.007991 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.008202 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.008287 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.008502 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.008588 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.008806 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.008900 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.009117 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.009210 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.009417 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.009511 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.009715 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.009809 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.010019 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.010106 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.010316 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.010414 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.010635 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.010726 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.010943 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.011043 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.011262 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.011355 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.011569 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.011655 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.011872 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.011959 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.012174 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.012266 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.012474 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.012596 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.012777 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.012863 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.013078 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.013173 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.013386 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.013472 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.013686 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.013773 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.013987 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.014081 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.014288 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.014373 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.014604 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.014692 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.014914 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.015013 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.015236 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.015323 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.015546 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.015633 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.015850 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.015946 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.016153 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.016239 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.016455 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.016543 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.016758 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.016851 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.017065 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.017151 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.017388 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.017473 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.017701 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.017788 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.018015 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.018101 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.018331 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.018416 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.018668 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.018759 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.018983 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.019122 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.019298 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.019384 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.019602 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.019739 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.019909 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.020049 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.020218 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.020360 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.020527 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.020743 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.020875 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.021016 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.021158 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.021303 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.021443 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.021533 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.021726 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.021812 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.022292 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.022467 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.022630 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.022720 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.022946 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.023042 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.023783 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.023886 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.024098 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.024185 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.024406 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.024491 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.024718 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.024814 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.025027 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.025112 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.025332 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.025418 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.025642 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.025728 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.025949 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.026033 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.026259 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.026343 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.026565 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.026699 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.026899 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.027018 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.027209 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.027335 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.027512 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.027650 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.027822 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.027958 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.028131 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.028270 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.028433 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.028583 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.028754 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.028903 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.029063 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.029204 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.029367 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.029519 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.029673 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.029943 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.030029 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.030263 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.030350 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.030563 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.030712 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.030904 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.031012 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.031215 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.031325 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.031522 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.031635 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.031834 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.031921 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.032161 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.032249 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.032469 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.032554 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.032775 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.032870 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.033080 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.033167 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.033403 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.033489 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.033709 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.033805 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.034031 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.034118 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.034408 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.034501 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.034747 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.034849 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.035053 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.035140 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.035356 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.035478 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.035664 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.035795 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.035984 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.036106 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.036314 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.036433 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.036618 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.036759 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.036919 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.037083 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.037239 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.037391 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.037541 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.037707 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.037862 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.038020 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.038275 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.038363 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.038584 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.038689 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.039005 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.039093 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.039333 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.039447 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.039648 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.039782 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.039974 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.040062 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.040298 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.040391 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.040613 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.040699 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.040936 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.041023 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.041242 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.041354 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.041556 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.041679 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.041867 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.041992 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.042195 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.042315 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.042519 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.042663 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.042868 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.042975 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.043183 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.043269 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.043489 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.043585 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.043811 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.043897 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.044133 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.044219 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.044447 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.044543 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.044763 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.044856 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.045076 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.045162 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.045389 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.045476 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.045700 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.045786 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.046006 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.046091 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.046312 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.046399 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.046662 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.046763 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.046973 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.047059 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.047285 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.047372 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.047589 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.047675 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.047892 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.047978 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.048213 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.048301 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.048515 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.048602 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.048825 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.048920 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.049132 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.049218 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.049438 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.049531 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.049735 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.049880 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.050039 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.050125 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.050357 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.050451 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.050681 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.050786 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.051006 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.051092 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.051317 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.051403 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.051638 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.051733 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.051949 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.052034 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.052257 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.052352 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.052575 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.052663 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.052881 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.052975 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.053185 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.053271 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.053486 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.053574 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.053787 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.053873 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.054094 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.054193 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.054997 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.055107 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.055309 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.055397 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.055617 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.055703 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.055922 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.056031 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.056232 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.056344 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.056536 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.056677 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.056838 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.057002 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.057143 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.057318 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.057466 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.057635 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.057773 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.057957 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.058094 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.058258 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.058403 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.058557 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.058734 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.058893 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.059043 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.059196 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.059345 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.059500 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.059689 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.059801 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.059999 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.060093 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.060333 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.060422 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.060651 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.060737 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.060968 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.061053 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.061289 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.061378 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.061590 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.061676 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.061909 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.062010 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.062214 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.062344 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.062516 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.062653 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.062848 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.062935 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.063149 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.063238 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.063464 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.063549 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.063778 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.063873 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.064091 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.064184 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.064402 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.064497 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.064718 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.064818 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.065033 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.065127 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.065338 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.065432 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.065658 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.065861 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.065971 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.066196 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.066283 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.066516 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.066621 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.066860 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.066949 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.067178 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.067265 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.067495 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.067591 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.067804 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.067888 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.068110 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.068197 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.068422 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.068515 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.068731 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.068817 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.069043 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.069125 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.069372 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.069561 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.069696 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.069895 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.070068 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.070318 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.070476 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.070659 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.070751 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.070979 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.071064 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.071293 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.071390 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.071606 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.071692 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.071921 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.072016 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.072233 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.072333 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.072546 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.072641 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.072862 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.072949 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.073190 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.073287 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.073504 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.073590 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.073818 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.073905 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.074133 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.074221 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.074449 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.074535 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.074788 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.074876 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.075103 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.075190 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.075415 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.075501 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.075731 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.075896 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.076049 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.076136 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.076357 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.076450 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.076670 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.076766 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.076983 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.077070 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.077298 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.077400 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.077608 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.077704 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.077916 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.078003 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.078226 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.078438 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.078534 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.078787 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.078893 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.079127 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.079216 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.079455 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.079554 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.079767 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.079855 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.080086 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.080213 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.080406 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.080493 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.080718 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.080825 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.081031 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.081137 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.081339 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.081428 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.081652 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.081745 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.081962 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.082168 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.082267 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.082482 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.082575 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.082844 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.082934 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.083169 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.083272 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.083494 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.083580 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.083801 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.083887 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.084113 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.084333 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.084419 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.084681 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.084768 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.085006 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.085106 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.085312 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.085406 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.086155 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.086251 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.086459 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.086555 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.086792 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.086878 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.087100 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.087185 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.087403 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.087500 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.087707 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.087794 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.088014 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.088099 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.088323 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.088540 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.088627 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.088885 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.088971 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.089200 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.089296 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.089508 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.089593 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.089811 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.089897 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.090123 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.090221 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.090427 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.090520 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.090774 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.090873 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.091078 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.091173 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.091381 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.091466 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.091687 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.091774 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.091993 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.092077 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.092295 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.092382 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.092598 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.092682 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.092899 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.092986 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.093202 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.093295 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.093508 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.093602 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.093809 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.093903 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.094109 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.094204 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.094414 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.094499 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.094748 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.094836 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.095052 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.095138 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.095351 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.095446 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.095659 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.095745 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.095962 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.096048 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.096264 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.096358 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.096565 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.096650 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.096864 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.096951 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.097172 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.097268 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.097473 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.097566 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.097780 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.097873 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.098082 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.098179 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.098391 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.098477 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.098720 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.098810 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.099032 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.099278 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.099365 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.099616 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.099702 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.099938 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.100033 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.100254 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.100339 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.100568 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.100663 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.100876 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.100976 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.101198 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.101309 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.101538 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.101624 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.101865 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.101961 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.102179 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.102274 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.102492 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.102578 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.102834 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.103067 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.103154 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.103407 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.103494 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.103728 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.103829 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.104042 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.104163 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.104355 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.104443 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.104664 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.104758 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.104969 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.105064 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.105274 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.105361 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.105589 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.105683 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.105896 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.105982 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.106205 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.106292 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.106516 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.106630 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.106852 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.106939 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.107165 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.107252 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.107475 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.107564 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.107785 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.107870 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.108094 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.108178 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.108402 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.108487 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.108709 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.108794 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.109015 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.109109 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.109322 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.109414 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.109632 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.109726 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.109946 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.110040 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.110251 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.110337 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.110609 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.110705 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.110929 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.111029 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.111243 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.111337 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.111559 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.111654 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.111866 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.111954 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.112174 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.112259 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.112482 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.112576 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.112788 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.112875 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.113100 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.113185 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.113418 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.113502 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.113729 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.113823 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.114030 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.114116 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.114391 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.114492 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.114746 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.114837 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.115056 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.115143 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.115365 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.115464 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.115672 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.115758 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.115982 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.116066 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.116301 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.116396 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.116608 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.116693 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.117422 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.117525 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.117727 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.117814 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.118037 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.118124 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.118343 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.118429 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.118681 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.118771 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.118989 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.119075 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.119297 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.119395 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.119606 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.119701 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.119908 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.119996 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.120212 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.120298 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.120515 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.120663 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.120819 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.120908 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.121121 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.121222 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.121419 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.121512 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.121726 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.121812 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.122025 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.122119 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.122326 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.122454 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.122643 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.122732 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.122951 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.123056 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.123253 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.123339 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.123549 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.123635 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.123850 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.123945 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.124155 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.124242 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.124456 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.124559 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.124759 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.124887 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.125060 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.125147 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.125367 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.125454 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.125671 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.125758 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.125973 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.126059 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.126272 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.126365 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.126573 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.126686 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.126898 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.126984 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.127226 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.127319 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.127557 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.127652 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.127869 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.127955 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.128183 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.128279 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.128489 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.128575 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.128800 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.128884 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.129104 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.129199 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.129423 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.129517 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.129737 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.129822 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.130047 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.130141 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.130354 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.130440 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.130704 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.130794 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.131012 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.131106 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.131325 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.131411 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.131633 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.131735 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.131942 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.132029 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.132250 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.132335 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.132620 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.132721 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.132935 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.133023 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.133247 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.133333 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.133566 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.133662 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.133885 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.133971 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.134206 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.134299 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.134526 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.134646 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.134863 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.134948 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.135171 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.135256 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.135499 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.135594 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.135813 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.135899 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.136123 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.136209 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.136438 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.136601 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.136747 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.136835 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.137057 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.137143 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.137369 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.137456 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.137685 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.137779 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.137927 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 16 22:52:13.138014 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.138318 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.138646 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.138977 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.139301 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.139647 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.139962 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.140304 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.140632 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.140950 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.141260 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.141566 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:52:13.141808 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 16 22:52:13.200329 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: INFO dbcounter [None req-84b5151b-e62a-4cb7-acab-01b34ff3e8d2 None None] Registered counter for database nova_api Jun 16 22:52:13.214212 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: INFO dbcounter [None req-706aa42a-bf97-487f-b07f-11a9395417b5 None None] Registered counter for database nova_api Jun 16 22:52:13.225972 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG oslo_db.sqlalchemy.engines [None req-84b5151b-e62a-4cb7-acab-01b34ff3e8d2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103024) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 22:52:13.234232 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG oslo_db.sqlalchemy.engines [None req-706aa42a-bf97-487f-b07f-11a9395417b5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103023) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 22:52:13.237528 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG dbcounter [-] [103024] Writer thread running {{(pid=103024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 22:52:13.240679 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG dbcounter [-] [103023] Writer thread running {{(pid=103023) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 22:52:13.298263 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.context [None req-706aa42a-bf97-487f-b07f-11a9395417b5 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5f428d07-ff1a-4378-acf2-68efcfdb27a3(cell1) {{(pid=103023) load_cells /opt/stack/nova/nova/context.py:464}} Jun 16 22:52:13.298462 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.context [None req-84b5151b-e62a-4cb7-acab-01b34ff3e8d2 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5f428d07-ff1a-4378-acf2-68efcfdb27a3(cell1) {{(pid=103024) load_cells /opt/stack/nova/nova/context.py:464}} Jun 16 22:52:13.302355 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG oslo_concurrency.lockutils [None req-84b5151b-e62a-4cb7-acab-01b34ff3e8d2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 22:52:13.302478 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG oslo_concurrency.lockutils [None req-706aa42a-bf97-487f-b07f-11a9395417b5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103023) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 22:52:13.303932 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG oslo_concurrency.lockutils [None req-84b5151b-e62a-4cb7-acab-01b34ff3e8d2 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 22:52:13.304028 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG oslo_concurrency.lockutils [None req-706aa42a-bf97-487f-b07f-11a9395417b5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103023) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 22:52:13.305331 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG oslo_concurrency.lockutils [None req-706aa42a-bf97-487f-b07f-11a9395417b5 None None] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103023) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 22:52:13.305435 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG oslo_concurrency.lockutils [None req-84b5151b-e62a-4cb7-acab-01b34ff3e8d2 None None] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 22:52:13.307319 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG oslo_concurrency.lockutils [None req-84b5151b-e62a-4cb7-acab-01b34ff3e8d2 None None] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 22:52:13.307423 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG oslo_concurrency.lockutils [None req-706aa42a-bf97-487f-b07f-11a9395417b5 None None] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103023) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 22:52:13.309281 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: INFO dbcounter [None req-706aa42a-bf97-487f-b07f-11a9395417b5 None None] Registered counter for database nova_cell0 Jun 16 22:52:13.309370 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: INFO dbcounter [None req-84b5151b-e62a-4cb7-acab-01b34ff3e8d2 None None] Registered counter for database nova_cell0 Jun 16 22:52:13.313083 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: INFO dbcounter [None req-706aa42a-bf97-487f-b07f-11a9395417b5 None None] Registered counter for database nova_cell1 Jun 16 22:52:13.313206 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: INFO dbcounter [None req-84b5151b-e62a-4cb7-acab-01b34ff3e8d2 None None] Registered counter for database nova_cell1 Jun 16 22:52:13.320641 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG oslo_db.sqlalchemy.engines [None req-84b5151b-e62a-4cb7-acab-01b34ff3e8d2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103024) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 22:52:13.322091 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG oslo_db.sqlalchemy.engines [None req-706aa42a-bf97-487f-b07f-11a9395417b5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103023) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 22:52:13.325196 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG oslo_db.sqlalchemy.engines [None req-706aa42a-bf97-487f-b07f-11a9395417b5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103023) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 22:52:13.325337 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG dbcounter [-] [103024] Writer thread running {{(pid=103024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 22:52:13.327517 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG dbcounter [-] [103023] Writer thread running {{(pid=103023) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 22:52:13.329518 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG oslo_db.sqlalchemy.engines [None req-84b5151b-e62a-4cb7-acab-01b34ff3e8d2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103024) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 22:52:13.469183 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG dbcounter [-] [103024] Writer thread running {{(pid=103024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 22:52:13.471022 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG dbcounter [-] [103023] Writer thread running {{(pid=103023) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 22:52:13.478352 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: INFO dbcounter [None req-84b5151b-e62a-4cb7-acab-01b34ff3e8d2 None None] Registered counter for database nova_cell0 Jun 16 22:52:13.480263 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: INFO dbcounter [None req-706aa42a-bf97-487f-b07f-11a9395417b5 None None] Registered counter for database nova_cell0 Jun 16 22:52:13.485279 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG oslo_db.sqlalchemy.engines [None req-84b5151b-e62a-4cb7-acab-01b34ff3e8d2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103024) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 22:52:13.486768 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG oslo_db.sqlalchemy.engines [None req-706aa42a-bf97-487f-b07f-11a9395417b5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103023) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 22:52:13.489864 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG dbcounter [-] [103024] Writer thread running {{(pid=103024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 22:52:13.490946 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG dbcounter [-] [103023] Writer thread running {{(pid=103023) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 22:52:13.836830 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: WARNING keystonemiddleware.auth_token [None req-84b5151b-e62a-4cb7-acab-01b34ff3e8d2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 16 22:52:13.841165 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: WARNING keystonemiddleware.auth_token [None req-706aa42a-bf97-487f-b07f-11a9395417b5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 16 22:52:13.844075 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: WARNING keystonemiddleware.auth_token [None req-84b5151b-e62a-4cb7-acab-01b34ff3e8d2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 16 22:52:13.848261 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: WARNING keystonemiddleware.auth_token [None req-706aa42a-bf97-487f-b07f-11a9395417b5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 16 22:52:14.185771 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: WARNING keystonemiddleware.auth_token [None req-84b5151b-e62a-4cb7-acab-01b34ff3e8d2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 16 22:52:14.190393 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: WARNING keystonemiddleware.auth_token [None req-706aa42a-bf97-487f-b07f-11a9395417b5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 16 22:52:14.191869 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: WARNING keystonemiddleware.auth_token [None req-84b5151b-e62a-4cb7-acab-01b34ff3e8d2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 16 22:52:14.196361 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: WARNING keystonemiddleware.auth_token [None req-706aa42a-bf97-487f-b07f-11a9395417b5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 16 22:52:14.197071 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5622de9839c0 pid: 103024 (default app) Jun 16 22:52:14.199152 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi [None req-84b5151b-e62a-4cb7-acab-01b34ff3e8d2 None None] Calling method '>' {{(pid=103024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 22:52:14.200397 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: INFO nova.api.openstack.requestlog [None req-84b5151b-e62a-4cb7-acab-01b34ff3e8d2 None None] 10.222.0.17 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001815 Jun 16 22:52:14.200809 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: [pid: 103024|app: 0|req: 1/1] 10.222.0.17 () {50 vars in 788 bytes} [Thu Jun 16 22:52:14 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 22:52:14.201669 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5622de9839c0 pid: 103023 (default app) Jun 16 22:53:29.849514 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi [None req-84b5151b-e62a-4cb7-acab-01b34ff3e8d2 None None] Calling method '>' {{(pid=103024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 22:53:29.850509 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: INFO nova.api.openstack.requestlog [None req-84b5151b-e62a-4cb7-acab-01b34ff3e8d2 None None] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001404 Jun 16 22:53:29.851157 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: [pid: 103024|app: 0|req: 2/2] 10.222.0.17 () {54 vars in 930 bytes} [Thu Jun 16 22:53:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 22:53:29.862478 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG dbcounter [-] [103023] Writing DB stats nova_api:SELECT=3 {{(pid=103023) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 22:53:29.863410 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG dbcounter [-] [103023] Writing DB stats nova_cell1:SELECT=3 {{(pid=103023) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 22:53:29.864443 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG dbcounter [-] [103023] Writing DB stats nova_cell0:SELECT=3 {{(pid=103023) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 22:53:29.865248 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG dbcounter [-] [103023] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103023) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 22:53:30.280699 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi [None req-78d70b12-61bc-47f0-aee9-35dc29983f82 admin admin] Calling method '>' {{(pid=103023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 22:53:30.309919 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: INFO nova.api.openstack.requestlog [None req-78d70b12-61bc-47f0-aee9-35dc29983f82 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.452561 Jun 16 22:53:30.321211 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: [pid: 103023|app: 0|req: 1/3] 10.222.0.17 () {60 vars in 1291 bytes} [Thu Jun 16 22:53:29 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 22:53:32.504151 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi [None req-84b5151b-e62a-4cb7-acab-01b34ff3e8d2 None None] Calling method '>' {{(pid=103024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 22:53:32.505080 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: INFO nova.api.openstack.requestlog [None req-84b5151b-e62a-4cb7-acab-01b34ff3e8d2 None None] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001420 Jun 16 22:53:32.505473 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: [pid: 103024|app: 0|req: 3/4] 10.222.0.17 () {54 vars in 930 bytes} [Thu Jun 16 22:53:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 22:53:32.574970 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi [None req-5855b504-d0a4-492b-a288-461343ff6ff8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "c1", "rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "ram": 256, "name": "cirros256"}} {{(pid=103023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 22:53:32.593177 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 22:53:32.593177 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: warnings.warn(msg) Jun 16 22:53:32.623628 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: INFO nova.api.openstack.requestlog [None req-5855b504-d0a4-492b-a288-461343ff6ff8 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.112283 Jun 16 22:53:32.624911 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: [pid: 103023|app: 0|req: 2/5] 10.222.0.17 () {64 vars in 1282 bytes} [Thu Jun 16 22:53:32 2022] POST /compute/v2.1/flavors => generated 407 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 22:53:32.639904 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG dbcounter [-] [103024] Writing DB stats nova_api:SELECT=3 {{(pid=103024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 22:53:32.641208 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG dbcounter [-] [103024] Writing DB stats nova_cell0:SELECT=3 {{(pid=103024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 22:53:32.642035 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG dbcounter [-] [103024] Writing DB stats nova_cell1:SELECT=3 {{(pid=103024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 22:53:32.642926 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG dbcounter [-] [103024] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 22:53:32.849627 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi [None req-f1a1bf20-8f2d-4b23-b2df-52134eefbf99 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 22:53:32.852096 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 22:53:32.852096 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: warnings.warn(msg) Jun 16 22:53:32.919558 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: INFO nova.api.openstack.requestlog [None req-f1a1bf20-8f2d-4b23-b2df-52134eefbf99 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.284877 Jun 16 22:53:32.919986 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: [pid: 103024|app: 0|req: 4/6] 10.222.0.17 () {64 vars in 1335 bytes} [Thu Jun 16 22:53:32 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 22:53:35.106400 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi [None req-5855b504-d0a4-492b-a288-461343ff6ff8 admin admin] Calling method '>' {{(pid=103023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 22:53:35.107470 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: INFO nova.api.openstack.requestlog [None req-5855b504-d0a4-492b-a288-461343ff6ff8 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001513 Jun 16 22:53:35.107875 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: [pid: 103023|app: 0|req: 3/7] 10.222.0.17 () {54 vars in 930 bytes} [Thu Jun 16 22:53:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 22:53:35.220492 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi [None req-0db38a5f-870e-444f-9ce2-b17055ca4482 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 5, "id": "d1", "swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds512M", "vcpus": 1, "ram": 512}} {{(pid=103024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 22:53:35.246027 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 22:53:35.246027 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: warnings.warn(msg) Jun 16 22:53:35.266081 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: INFO nova.api.openstack.requestlog [None req-0db38a5f-870e-444f-9ce2-b17055ca4482 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.151739 Jun 16 22:53:35.267318 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: [pid: 103024|app: 0|req: 5/8] 10.222.0.17 () {64 vars in 1282 bytes} [Thu Jun 16 22:53:35 2022] POST /compute/v2.1/flavors => generated 404 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 22:53:35.280570 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi [None req-38b36eaf-2c32-45a7-ba5e-b550f1691136 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 22:53:35.281973 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 22:53:35.281973 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: warnings.warn(msg) Jun 16 22:53:35.313874 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: INFO nova.api.openstack.requestlog [None req-38b36eaf-2c32-45a7-ba5e-b550f1691136 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037396 Jun 16 22:53:35.314555 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: [pid: 103023|app: 0|req: 4/9] 10.222.0.17 () {64 vars in 1335 bytes} [Thu Jun 16 22:53:35 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 22:53:37.478719 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi [None req-0db38a5f-870e-444f-9ce2-b17055ca4482 admin admin] Calling method '>' {{(pid=103024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 22:53:37.479735 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: INFO nova.api.openstack.requestlog [None req-0db38a5f-870e-444f-9ce2-b17055ca4482 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Jun 16 22:53:37.480144 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: [pid: 103024|app: 0|req: 6/10] 10.222.0.17 () {54 vars in 930 bytes} [Thu Jun 16 22:53:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 22:53:37.546502 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi [None req-7382f78b-3c97-4c52-b822-da81960eabbc admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "d2", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 10, "name": "ds1G", "vcpus": 1, "swap": 0, "ram": 1024}} {{(pid=103023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 22:53:37.567528 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: INFO nova.api.openstack.requestlog [None req-7382f78b-3c97-4c52-b822-da81960eabbc admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.080925 Jun 16 22:53:37.568181 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: [pid: 103023|app: 0|req: 5/11] 10.222.0.17 () {64 vars in 1282 bytes} [Thu Jun 16 22:53:37 2022] POST /compute/v2.1/flavors => generated 404 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 22:53:37.581152 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi [None req-14a4c934-be6d-4633-b0eb-769c10554185 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 22:53:37.608470 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: INFO nova.api.openstack.requestlog [None req-14a4c934-be6d-4633-b0eb-769c10554185 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031466 Jun 16 22:53:37.609346 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: [pid: 103024|app: 0|req: 7/12] 10.222.0.17 () {64 vars in 1335 bytes} [Thu Jun 16 22:53:37 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 22:53:39.809829 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi [None req-7382f78b-3c97-4c52-b822-da81960eabbc admin admin] Calling method '>' {{(pid=103023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 22:53:39.810975 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: INFO nova.api.openstack.requestlog [None req-7382f78b-3c97-4c52-b822-da81960eabbc admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001571 Jun 16 22:53:39.811472 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: [pid: 103023|app: 0|req: 6/13] 10.222.0.17 () {54 vars in 930 bytes} [Thu Jun 16 22:53:39 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 22:53:39.870566 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi [None req-13e0f676-2388-4cc1-8f70-6a8cc034042a admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "swap": 0, "name": "ds2G", "rxtx_factor": 1.0, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d3", "os-flavor-access:is_public": true, "vcpus": 2}} {{(pid=103024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 22:53:39.888516 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: INFO nova.api.openstack.requestlog [None req-13e0f676-2388-4cc1-8f70-6a8cc034042a admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.071118 Jun 16 22:53:39.896011 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: [pid: 103024|app: 0|req: 8/14] 10.222.0.17 () {64 vars in 1282 bytes} [Thu Jun 16 22:53:39 2022] POST /compute/v2.1/flavors => generated 404 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 22:53:39.904224 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi [None req-31d86110-e418-488c-8e66-db01149a389a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 22:53:39.930563 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: INFO nova.api.openstack.requestlog [None req-31d86110-e418-488c-8e66-db01149a389a admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030066 Jun 16 22:53:39.931218 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: [pid: 103023|app: 0|req: 7/15] 10.222.0.17 () {64 vars in 1335 bytes} [Thu Jun 16 22:53:39 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 22:53:42.166875 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi [None req-13e0f676-2388-4cc1-8f70-6a8cc034042a admin admin] Calling method '>' {{(pid=103024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 22:53:42.167392 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: INFO nova.api.openstack.requestlog [None req-13e0f676-2388-4cc1-8f70-6a8cc034042a admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001481 Jun 16 22:53:42.167796 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: [pid: 103024|app: 0|req: 9/16] 10.222.0.17 () {54 vars in 930 bytes} [Thu Jun 16 22:53:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 22:53:42.232831 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi [None req-50043a61-4775-42f6-bf72-14042e9d15c4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "name": "ds4G", "rxtx_factor": 1.0, "vcpus": 4, "os-flavor-access:is_public": true, "id": "d4", "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096}} {{(pid=103023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 22:53:42.253431 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: INFO nova.api.openstack.requestlog [None req-50043a61-4775-42f6-bf72-14042e9d15c4 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.079088 Jun 16 22:53:42.254524 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: [pid: 103023|app: 0|req: 8/17] 10.222.0.17 () {64 vars in 1282 bytes} [Thu Jun 16 22:53:42 2022] POST /compute/v2.1/flavors => generated 404 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 16 22:53:42.267085 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi [None req-86a73f2c-c786-4540-9b06-cb1339a298d7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 22:53:42.289984 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: INFO nova.api.openstack.requestlog [None req-86a73f2c-c786-4540-9b06-cb1339a298d7 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027530 Jun 16 22:53:42.290920 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: [pid: 103024|app: 0|req: 10/18] 10.222.0.17 () {64 vars in 1335 bytes} [Thu Jun 16 22:53:42 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 22:53:44.498921 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi [None req-50043a61-4775-42f6-bf72-14042e9d15c4 admin admin] Calling method '>' {{(pid=103023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 22:53:44.499876 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: INFO nova.api.openstack.requestlog [None req-50043a61-4775-42f6-bf72-14042e9d15c4 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001537 Jun 16 22:53:44.500285 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: [pid: 103023|app: 0|req: 9/19] 10.222.0.17 () {54 vars in 930 bytes} [Thu Jun 16 22:53:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 22:53:44.560659 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi [None req-4a24bd49-ddc0-452a-816e-12929e3f603b admin admin] Calling method '>' {{(pid=103024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 22:53:44.583867 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: INFO nova.api.openstack.requestlog [None req-4a24bd49-ddc0-452a-816e-12929e3f603b admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.077050 Jun 16 22:53:44.584603 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: [pid: 103024|app: 0|req: 11/20] 10.222.0.17 () {60 vars in 1291 bytes} [Thu Jun 16 22:53:44 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 22:53:46.791379 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi [None req-50043a61-4775-42f6-bf72-14042e9d15c4 admin admin] Calling method '>' {{(pid=103023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 22:53:46.792413 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: INFO nova.api.openstack.requestlog [None req-50043a61-4775-42f6-bf72-14042e9d15c4 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001528 Jun 16 22:53:46.792823 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: [pid: 103023|app: 0|req: 10/21] 10.222.0.17 () {54 vars in 930 bytes} [Thu Jun 16 22:53:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 22:53:46.854213 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi [None req-72526d55-a251-4ed7-96e4-9e72e325c68e admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "id": "1", "rxtx_factor": 1.0, "disk": 1, "os-flavor-access:is_public": true, "name": "m1.tiny", "swap": 0, "vcpus": 1, "ram": 512}} {{(pid=103024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 22:53:46.873033 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: INFO nova.api.openstack.requestlog [None req-72526d55-a251-4ed7-96e4-9e72e325c68e admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.073815 Jun 16 22:53:46.873579 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: [pid: 103024|app: 0|req: 12/22] 10.222.0.17 () {64 vars in 1282 bytes} [Thu Jun 16 22:53:46 2022] POST /compute/v2.1/flavors => generated 402 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 22:53:46.885718 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi [None req-eff50595-ae42-4a32-a4c7-15c0b0e8ce82 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 22:53:46.911013 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: INFO nova.api.openstack.requestlog [None req-eff50595-ae42-4a32-a4c7-15c0b0e8ce82 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029116 Jun 16 22:53:46.911628 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: [pid: 103023|app: 0|req: 11/23] 10.222.0.17 () {64 vars in 1332 bytes} [Thu Jun 16 22:53:46 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 22:53:49.138771 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi [None req-72526d55-a251-4ed7-96e4-9e72e325c68e admin admin] Calling method '>' {{(pid=103024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 22:53:49.139914 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: INFO nova.api.openstack.requestlog [None req-72526d55-a251-4ed7-96e4-9e72e325c68e admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001614 Jun 16 22:53:49.140402 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: [pid: 103024|app: 0|req: 13/24] 10.222.0.17 () {54 vars in 930 bytes} [Thu Jun 16 22:53:49 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 22:53:49.202652 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi [None req-57b92e7c-72aa-4d44-aae2-7b4dd8a17402 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "vcpus": 1, "os-flavor-access:is_public": true, "swap": 0, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "2", "rxtx_factor": 1.0, "name": "m1.small"}} {{(pid=103023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 22:53:49.221099 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: INFO nova.api.openstack.requestlog [None req-57b92e7c-72aa-4d44-aae2-7b4dd8a17402 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.074039 Jun 16 22:53:49.221654 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: [pid: 103023|app: 0|req: 12/25] 10.222.0.17 () {64 vars in 1282 bytes} [Thu Jun 16 22:53:49 2022] POST /compute/v2.1/flavors => generated 405 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 22:53:49.233671 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi [None req-fe2af3ed-6931-497f-885d-1f612965ce2e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 22:53:49.257179 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: INFO nova.api.openstack.requestlog [None req-fe2af3ed-6931-497f-885d-1f612965ce2e admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027292 Jun 16 22:53:49.257762 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: [pid: 103024|app: 0|req: 14/26] 10.222.0.17 () {64 vars in 1332 bytes} [Thu Jun 16 22:53:49 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 22:53:51.445905 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi [None req-57b92e7c-72aa-4d44-aae2-7b4dd8a17402 admin admin] Calling method '>' {{(pid=103023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 22:53:51.447254 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: INFO nova.api.openstack.requestlog [None req-57b92e7c-72aa-4d44-aae2-7b4dd8a17402 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001940 Jun 16 22:53:51.447794 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: [pid: 103023|app: 0|req: 13/27] 10.222.0.17 () {54 vars in 930 bytes} [Thu Jun 16 22:53:51 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 22:53:51.508091 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi [None req-f256199a-ac00-4e5d-9803-938137ed112f admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "rxtx_factor": 1.0, "name": "m1.medium", "os-flavor-access:is_public": true, "ram": 4096, "swap": 0, "disk": 40, "id": "3", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 22:53:51.529316 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: INFO nova.api.openstack.requestlog [None req-f256199a-ac00-4e5d-9803-938137ed112f admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.074518 Jun 16 22:53:51.530017 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: [pid: 103024|app: 0|req: 15/28] 10.222.0.17 () {64 vars in 1282 bytes} [Thu Jun 16 22:53:51 2022] POST /compute/v2.1/flavors => generated 406 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 22:53:51.545288 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi [None req-5a6df95e-ce07-493c-8568-32631c49a632 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 22:53:51.571508 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: INFO nova.api.openstack.requestlog [None req-5a6df95e-ce07-493c-8568-32631c49a632 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030916 Jun 16 22:53:51.572088 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: [pid: 103023|app: 0|req: 14/29] 10.222.0.17 () {64 vars in 1332 bytes} [Thu Jun 16 22:53:51 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 22:53:53.754810 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi [None req-f256199a-ac00-4e5d-9803-938137ed112f admin admin] Calling method '>' {{(pid=103024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 22:53:53.755907 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: INFO nova.api.openstack.requestlog [None req-f256199a-ac00-4e5d-9803-938137ed112f admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001878 Jun 16 22:53:53.756339 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: [pid: 103024|app: 0|req: 16/30] 10.222.0.17 () {54 vars in 930 bytes} [Thu Jun 16 22:53:53 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 22:53:53.822891 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi [None req-25bd336d-f437-4080-bca5-9e4112bf209e admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 8192, "os-flavor-access:is_public": true, "vcpus": 4, "rxtx_factor": 1.0, "id": "4", "swap": 0, "name": "m1.large", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 80}} {{(pid=103023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 22:53:53.841863 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: INFO nova.api.openstack.requestlog [None req-25bd336d-f437-4080-bca5-9e4112bf209e admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.078986 Jun 16 22:53:53.842429 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: [pid: 103023|app: 0|req: 15/31] 10.222.0.17 () {64 vars in 1282 bytes} [Thu Jun 16 22:53:53 2022] POST /compute/v2.1/flavors => generated 405 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 16 22:53:53.854729 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi [None req-4922881f-2778-4b01-ab20-3426f99bfc38 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 22:53:53.881006 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: INFO nova.api.openstack.requestlog [None req-4922881f-2778-4b01-ab20-3426f99bfc38 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029935 Jun 16 22:53:53.881599 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: [pid: 103024|app: 0|req: 17/32] 10.222.0.17 () {64 vars in 1332 bytes} [Thu Jun 16 22:53:53 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 22:53:56.085812 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi [None req-25bd336d-f437-4080-bca5-9e4112bf209e admin admin] Calling method '>' {{(pid=103023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 22:53:56.087548 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: INFO nova.api.openstack.requestlog [None req-25bd336d-f437-4080-bca5-9e4112bf209e admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002162 Jun 16 22:53:56.087948 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: [pid: 103023|app: 0|req: 16/33] 10.222.0.17 () {54 vars in 930 bytes} [Thu Jun 16 22:53:56 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 22:53:56.149378 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi [None req-7d149893-7966-41fa-8673-d0672bbda829 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "5", "swap": 0, "vcpus": 8, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 160, "os-flavor-access:is_public": true, "ram": 16384, "name": "m1.xlarge"}} {{(pid=103024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 22:53:56.169194 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: INFO nova.api.openstack.requestlog [None req-7d149893-7966-41fa-8673-d0672bbda829 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.075624 Jun 16 22:53:56.169771 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: [pid: 103024|app: 0|req: 18/34] 10.222.0.17 () {64 vars in 1282 bytes} [Thu Jun 16 22:53:56 2022] POST /compute/v2.1/flavors => generated 408 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 16 22:53:56.181993 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi [None req-eec942ee-4491-4bd9-b81f-864ad9978262 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 22:53:56.208333 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: INFO nova.api.openstack.requestlog [None req-eec942ee-4491-4bd9-b81f-864ad9978262 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029874 Jun 16 22:53:56.219404 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: [pid: 103023|app: 0|req: 17/35] 10.222.0.17 () {64 vars in 1332 bytes} [Thu Jun 16 22:53:56 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 22:54:20.084940 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi [None req-7d149893-7966-41fa-8673-d0672bbda829 admin admin] Calling method '>' {{(pid=103024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 22:54:20.085946 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: INFO nova.api.openstack.requestlog [None req-7d149893-7966-41fa-8673-d0672bbda829 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001417 Jun 16 22:54:20.086338 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: [pid: 103024|app: 0|req: 19/36] 10.222.0.17 () {54 vars in 930 bytes} [Thu Jun 16 22:54:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 22:54:20.096743 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG dbcounter [-] [103023] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=103023) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 22:54:20.147075 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi [None req-3e57143a-6a5a-41ec-a1f4-d54264435b1a admin admin] Calling method '>' {{(pid=103023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 22:54:20.163629 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: INFO nova.api.openstack.requestlog [None req-3e57143a-6a5a-41ec-a1f4-d54264435b1a admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.071434 Jun 16 22:54:20.164155 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: [pid: 103023|app: 0|req: 18/37] 10.222.0.17 () {60 vars in 1291 bytes} [Thu Jun 16 22:54:20 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 22:54:21.139593 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi [None req-7d149893-7966-41fa-8673-d0672bbda829 admin admin] Calling method '>' {{(pid=103024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 22:54:21.140899 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: INFO nova.api.openstack.requestlog [None req-7d149893-7966-41fa-8673-d0672bbda829 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Jun 16 22:54:21.141299 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: [pid: 103024|app: 0|req: 20/38] 10.222.0.17 () {56 vars in 1074 bytes} [Thu Jun 16 22:54:21 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 22:54:21.333295 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi [None req-f6ffadde-dea3-4020-b080-2d8024db03e6 admin admin] Calling method '>' {{(pid=103023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 22:54:21.339134 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: INFO nova.api.openstack.wsgi [None req-f6ffadde-dea3-4020-b080-2d8024db03e6 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 16 22:54:21.343207 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi [None req-f6ffadde-dea3-4020-b080-2d8024db03e6 admin admin] Request method failure captured: Jun 16 22:54:21.343207 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 16 22:54:21.343207 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: Accept: application/json Jun 16 22:54:21.343207 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: Accept-Encoding: gzip, deflate Jun 16 22:54:21.343207 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: Connection: keep-alive Jun 16 22:54:21.343207 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: Content-Length: 0 Jun 16 22:54:21.343207 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: Host: 10.222.0.17 Jun 16 22:54:21.343207 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: Openstack-Api-Version: compute 2.90 Jun 16 22:54:21.343207 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: Openstack-System-Scope: None Jun 16 22:54:21.343207 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: User-Agent: python-novaclient Jun 16 22:54:21.343207 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: X-Auth-Token: gAAAAABiq7SdIaF3ss0FcKQjBAM4jswNnePRlxIUiI4sGCwUu_c2mK9n0rjcea-WnWJrNiOLx7ejnxNmpI9zbwJn-DmUcWUjlLPB9PScDbP8f9Oi92q4Yph7-UF4Z7j1CmTJr_IVtQfmmMPN7WUucduTa7zaTZDFjXCcDwOxpj0NJrZWADclzWY Jun 16 22:54:21.343207 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: X-Domain-Id: None Jun 16 22:54:21.343207 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: X-Domain-Name: None Jun 16 22:54:21.343207 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: X-Identity-Status: Confirmed Jun 16 22:54:21.343207 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: X-Is-Admin-Project: True Jun 16 22:54:21.343207 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: X-Openstack-Nova-Api-Version: 2.90 Jun 16 22:54:21.343207 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: X-Project-Domain-Id: default Jun 16 22:54:21.343207 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: X-Project-Domain-Name: Default Jun 16 22:54:21.343207 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: X-Project-Id: 2ffbb7bcd828426c857e7fce279519f7 Jun 16 22:54:21.343207 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: X-Project-Name: admin Jun 16 22:54:21.343207 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: X-Role: reader,member,admin Jun 16 22:54:21.343207 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: X-Roles: reader,member,admin Jun 16 22:54:21.344809 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/2ffbb7bcd828426c857e7fce279519f7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_2ffbb7bcd828426c857e7fce279519f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2ffbb7bcd828426c857e7fce279519f7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2ffbb7bcd828426c857e7fce279519f7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Jun 16 22:54:21.344809 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: X-Tenant: admin Jun 16 22:54:21.344809 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: X-Tenant-Id: 2ffbb7bcd828426c857e7fce279519f7 Jun 16 22:54:21.344809 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: X-Tenant-Name: admin Jun 16 22:54:21.344809 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: X-User: admin Jun 16 22:54:21.344809 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: X-User-Domain-Id: default Jun 16 22:54:21.344809 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: X-User-Domain-Name: Default Jun 16 22:54:21.344809 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: X-User-Id: 1288d3a7956c42f7ad18e2e126c7dd07 Jun 16 22:54:21.344809 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: X-User-Name: admin Jun 16 22:54:21.344809 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: method: > Jun 16 22:54:21.344809 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: exception: Flavor 42 could not be found. Jun 16 22:54:21.344809 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: action_args: {'id': '42'} Jun 16 22:54:21.344809 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: {{(pid=103023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 22:54:21.344809 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 22:54:21.345727 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 16 22:54:21.345727 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 16 22:54:21.345727 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 16 22:54:21.345727 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 16 22:54:21.345727 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 22:54:21.345727 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 22:54:21.345727 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 16 22:54:21.345727 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 16 22:54:21.345727 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 16 22:54:21.345727 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 22:54:21.345727 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 16 22:54:21.345727 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 16 22:54:21.345727 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 16 22:54:21.345727 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi Jun 16 22:54:21.345727 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 22:54:21.345727 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi Jun 16 22:54:21.345727 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 22:54:21.345727 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 22:54:21.345727 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 22:54:21.346913 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 22:54:21.346913 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 22:54:21.346913 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 22:54:21.346913 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 22:54:21.346913 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 16 22:54:21.346913 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 16 22:54:21.346913 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 16 22:54:21.346913 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi Jun 16 22:54:21.346913 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 22:54:21.346913 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi Jun 16 22:54:21.346913 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 22:54:21.346913 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 22:54:21.346913 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 22:54:21.346913 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 22:54:21.346913 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 22:54:21.346913 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 16 22:54:21.346913 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi Jun 16 22:54:21.346913 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi [None req-f6ffadde-dea3-4020-b080-2d8024db03e6 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103023) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 22:54:21.348139 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: INFO nova.api.openstack.requestlog [None req-f6ffadde-dea3-4020-b080-2d8024db03e6 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.063020 Jun 16 22:54:21.348139 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: [pid: 103023|app: 0|req: 19/39] 10.222.0.17 () {60 vars in 1190 bytes} [Thu Jun 16 22:54:21 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 16 22:54:21.354268 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi [None req-35725881-591d-419b-b82f-3e4121c3279b admin admin] Calling method '>' {{(pid=103024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 22:54:21.357207 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG dbcounter [-] [103024] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 22:54:21.376662 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: INFO nova.api.openstack.requestlog [None req-35725881-591d-419b-b82f-3e4121c3279b admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026012 Jun 16 22:54:21.377200 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: [pid: 103024|app: 0|req: 21/40] 10.222.0.17 () {60 vars in 1210 bytes} [Thu Jun 16 22:54:21 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 22:54:21.386521 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi [None req-d48683a0-b465-46a4-8c12-5af45c8aefc7 admin admin] Calling method '>' {{(pid=103023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 22:54:21.408054 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: INFO nova.api.openstack.requestlog [None req-d48683a0-b465-46a4-8c12-5af45c8aefc7 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025044 Jun 16 22:54:21.408579 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: [pid: 103023|app: 0|req: 20/41] 10.222.0.17 () {60 vars in 1210 bytes} [Thu Jun 16 22:54:21 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 22:54:21.417658 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi [None req-6e3fa8f1-3f42-4b00-b454-857ed434c8bf admin admin] Calling method '>' {{(pid=103024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 22:54:21.425284 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: INFO nova.api.openstack.wsgi [None req-6e3fa8f1-3f42-4b00-b454-857ed434c8bf admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 16 22:54:21.428536 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi [None req-6e3fa8f1-3f42-4b00-b454-857ed434c8bf admin admin] Request method failure captured: Jun 16 22:54:21.428536 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 16 22:54:21.428536 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: Accept: application/json Jun 16 22:54:21.428536 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: Accept-Encoding: gzip, deflate Jun 16 22:54:21.428536 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: Connection: keep-alive Jun 16 22:54:21.428536 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: Content-Length: 0 Jun 16 22:54:21.428536 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: Host: 10.222.0.17 Jun 16 22:54:21.428536 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: Openstack-Api-Version: compute 2.90 Jun 16 22:54:21.428536 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: Openstack-System-Scope: None Jun 16 22:54:21.428536 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: User-Agent: python-novaclient Jun 16 22:54:21.428536 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: X-Auth-Token: gAAAAABiq7SdIaF3ss0FcKQjBAM4jswNnePRlxIUiI4sGCwUu_c2mK9n0rjcea-WnWJrNiOLx7ejnxNmpI9zbwJn-DmUcWUjlLPB9PScDbP8f9Oi92q4Yph7-UF4Z7j1CmTJr_IVtQfmmMPN7WUucduTa7zaTZDFjXCcDwOxpj0NJrZWADclzWY Jun 16 22:54:21.428536 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: X-Domain-Id: None Jun 16 22:54:21.428536 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: X-Domain-Name: None Jun 16 22:54:21.428536 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: X-Identity-Status: Confirmed Jun 16 22:54:21.428536 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: X-Is-Admin-Project: True Jun 16 22:54:21.428536 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: X-Openstack-Nova-Api-Version: 2.90 Jun 16 22:54:21.428536 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: X-Project-Domain-Id: default Jun 16 22:54:21.428536 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: X-Project-Domain-Name: Default Jun 16 22:54:21.428536 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: X-Project-Id: 2ffbb7bcd828426c857e7fce279519f7 Jun 16 22:54:21.428536 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: X-Project-Name: admin Jun 16 22:54:21.428536 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: X-Role: reader,member,admin Jun 16 22:54:21.428536 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: X-Roles: reader,member,admin Jun 16 22:54:21.429993 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/2ffbb7bcd828426c857e7fce279519f7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_2ffbb7bcd828426c857e7fce279519f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2ffbb7bcd828426c857e7fce279519f7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2ffbb7bcd828426c857e7fce279519f7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Jun 16 22:54:21.429993 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: X-Tenant: admin Jun 16 22:54:21.429993 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: X-Tenant-Id: 2ffbb7bcd828426c857e7fce279519f7 Jun 16 22:54:21.429993 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: X-Tenant-Name: admin Jun 16 22:54:21.429993 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: X-User: admin Jun 16 22:54:21.429993 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: X-User-Domain-Id: default Jun 16 22:54:21.429993 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: X-User-Domain-Name: Default Jun 16 22:54:21.429993 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: X-User-Id: 1288d3a7956c42f7ad18e2e126c7dd07 Jun 16 22:54:21.429993 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: X-User-Name: admin Jun 16 22:54:21.429993 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: method: > Jun 16 22:54:21.429993 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: exception: Flavor 42 could not be found. Jun 16 22:54:21.429993 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: action_args: {'id': '42'} Jun 16 22:54:21.429993 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: {{(pid=103024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 22:54:21.429993 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 22:54:21.430959 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 16 22:54:21.430959 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 16 22:54:21.430959 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 16 22:54:21.430959 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 16 22:54:21.430959 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 22:54:21.430959 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 22:54:21.430959 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 16 22:54:21.430959 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 16 22:54:21.430959 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 16 22:54:21.430959 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 22:54:21.430959 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 16 22:54:21.430959 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 16 22:54:21.430959 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 16 22:54:21.430959 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi Jun 16 22:54:21.430959 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 22:54:21.430959 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi Jun 16 22:54:21.430959 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 22:54:21.430959 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 22:54:21.430959 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 22:54:21.432176 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 22:54:21.432176 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 22:54:21.432176 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 22:54:21.432176 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 22:54:21.432176 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 16 22:54:21.432176 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 16 22:54:21.432176 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 16 22:54:21.432176 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi Jun 16 22:54:21.432176 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 22:54:21.432176 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi Jun 16 22:54:21.432176 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 22:54:21.432176 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 22:54:21.432176 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 22:54:21.432176 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 22:54:21.432176 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 22:54:21.432176 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 16 22:54:21.432176 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi Jun 16 22:54:21.432176 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi [None req-6e3fa8f1-3f42-4b00-b454-857ed434c8bf admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103024) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 22:54:21.433323 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: INFO nova.api.openstack.requestlog [None req-6e3fa8f1-3f42-4b00-b454-857ed434c8bf admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015723 Jun 16 22:54:21.433323 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: [pid: 103024|app: 0|req: 22/42] 10.222.0.17 () {60 vars in 1190 bytes} [Thu Jun 16 22:54:21 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 16 22:54:22.294682 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi [None req-d48683a0-b465-46a4-8c12-5af45c8aefc7 admin admin] Calling method '>' {{(pid=103023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 22:54:22.295804 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: INFO nova.api.openstack.requestlog [None req-d48683a0-b465-46a4-8c12-5af45c8aefc7 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002025 Jun 16 22:54:22.296217 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: [pid: 103023|app: 0|req: 21/43] 10.222.0.17 () {56 vars in 1074 bytes} [Thu Jun 16 22:54:22 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 22:54:22.488481 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi [None req-041df235-8c7f-4c56-9a87-a8547897b342 admin admin] Calling method '>' {{(pid=103024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 22:54:22.494205 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: INFO nova.api.openstack.wsgi [None req-041df235-8c7f-4c56-9a87-a8547897b342 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 16 22:54:22.495710 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi [None req-041df235-8c7f-4c56-9a87-a8547897b342 admin admin] Request method failure captured: Jun 16 22:54:22.495710 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 16 22:54:22.495710 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: Accept: application/json Jun 16 22:54:22.495710 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: Accept-Encoding: gzip, deflate Jun 16 22:54:22.495710 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: Connection: keep-alive Jun 16 22:54:22.495710 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: Content-Length: 0 Jun 16 22:54:22.495710 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: Host: 10.222.0.17 Jun 16 22:54:22.495710 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: Openstack-Api-Version: compute 2.90 Jun 16 22:54:22.495710 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: Openstack-System-Scope: None Jun 16 22:54:22.495710 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: User-Agent: python-novaclient Jun 16 22:54:22.495710 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: X-Auth-Token: gAAAAABiq7SeLAj-cu5EfGvRVSm5IkZBuq_-w2Lr81FTwczB1UDbU-9hafOQzpltk-MsS7DaEhNBzOQHogL5ZaDJVmkcwQsRYmSFggnyV8SxzBdYaNLa6la2Hi4-sMvOdDMSxqhcQfAPE3rSfWy0zwN6IbsWq7GRy7cSI7CdWWwARflcxUjjpNY Jun 16 22:54:22.495710 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: X-Domain-Id: None Jun 16 22:54:22.495710 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: X-Domain-Name: None Jun 16 22:54:22.495710 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: X-Identity-Status: Confirmed Jun 16 22:54:22.495710 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: X-Is-Admin-Project: True Jun 16 22:54:22.495710 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: X-Openstack-Nova-Api-Version: 2.90 Jun 16 22:54:22.495710 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: X-Project-Domain-Id: default Jun 16 22:54:22.495710 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: X-Project-Domain-Name: Default Jun 16 22:54:22.495710 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: X-Project-Id: 2ffbb7bcd828426c857e7fce279519f7 Jun 16 22:54:22.495710 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: X-Project-Name: admin Jun 16 22:54:22.495710 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: X-Role: reader,member,admin Jun 16 22:54:22.495710 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: X-Roles: reader,member,admin Jun 16 22:54:22.497171 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/2ffbb7bcd828426c857e7fce279519f7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_2ffbb7bcd828426c857e7fce279519f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2ffbb7bcd828426c857e7fce279519f7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2ffbb7bcd828426c857e7fce279519f7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Jun 16 22:54:22.497171 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: X-Tenant: admin Jun 16 22:54:22.497171 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: X-Tenant-Id: 2ffbb7bcd828426c857e7fce279519f7 Jun 16 22:54:22.497171 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: X-Tenant-Name: admin Jun 16 22:54:22.497171 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: X-User: admin Jun 16 22:54:22.497171 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: X-User-Domain-Id: default Jun 16 22:54:22.497171 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: X-User-Domain-Name: Default Jun 16 22:54:22.497171 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: X-User-Id: 1288d3a7956c42f7ad18e2e126c7dd07 Jun 16 22:54:22.497171 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: X-User-Name: admin Jun 16 22:54:22.497171 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: method: > Jun 16 22:54:22.497171 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: exception: Flavor 84 could not be found. Jun 16 22:54:22.497171 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: action_args: {'id': '84'} Jun 16 22:54:22.497171 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: {{(pid=103024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 22:54:22.497171 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 22:54:22.498177 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 16 22:54:22.498177 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 16 22:54:22.498177 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 16 22:54:22.498177 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 16 22:54:22.498177 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 22:54:22.498177 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 22:54:22.498177 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 16 22:54:22.498177 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 16 22:54:22.498177 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 16 22:54:22.498177 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 22:54:22.498177 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 16 22:54:22.498177 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 16 22:54:22.498177 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 16 22:54:22.498177 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi Jun 16 22:54:22.498177 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 22:54:22.498177 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi Jun 16 22:54:22.498177 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 22:54:22.498177 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 22:54:22.498177 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 22:54:22.499547 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 22:54:22.499547 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 22:54:22.499547 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 22:54:22.499547 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 22:54:22.499547 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 16 22:54:22.499547 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 16 22:54:22.499547 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 16 22:54:22.499547 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi Jun 16 22:54:22.499547 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 22:54:22.499547 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi Jun 16 22:54:22.499547 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 22:54:22.499547 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 22:54:22.499547 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 22:54:22.499547 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 22:54:22.499547 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 22:54:22.499547 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 16 22:54:22.499547 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi Jun 16 22:54:22.499547 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi [None req-041df235-8c7f-4c56-9a87-a8547897b342 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103024) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 22:54:22.500737 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: INFO nova.api.openstack.requestlog [None req-041df235-8c7f-4c56-9a87-a8547897b342 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.060249 Jun 16 22:54:22.500737 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: [pid: 103024|app: 0|req: 23/44] 10.222.0.17 () {60 vars in 1190 bytes} [Thu Jun 16 22:54:22 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 16 22:54:22.506496 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi [None req-87218460-c34a-424a-a41d-e0828a6e9fc9 admin admin] Calling method '>' {{(pid=103023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 22:54:22.522175 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: INFO nova.api.openstack.requestlog [None req-87218460-c34a-424a-a41d-e0828a6e9fc9 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019243 Jun 16 22:54:22.522722 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: [pid: 103023|app: 0|req: 22/45] 10.222.0.17 () {60 vars in 1210 bytes} [Thu Jun 16 22:54:22 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 22:54:22.532524 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi [None req-93520189-56ab-4dcc-aeeb-76356627ab49 admin admin] Calling method '>' {{(pid=103024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 22:54:22.545852 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: INFO nova.api.openstack.requestlog [None req-93520189-56ab-4dcc-aeeb-76356627ab49 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016736 Jun 16 22:54:22.546366 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: [pid: 103024|app: 0|req: 24/46] 10.222.0.17 () {60 vars in 1210 bytes} [Thu Jun 16 22:54:22 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 22:54:22.555219 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi [None req-9c39a3a8-a7eb-40bb-b5ac-fba28426318e admin admin] Calling method '>' {{(pid=103023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 22:54:22.560591 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: INFO nova.api.openstack.wsgi [None req-9c39a3a8-a7eb-40bb-b5ac-fba28426318e admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 16 22:54:22.562093 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi [None req-9c39a3a8-a7eb-40bb-b5ac-fba28426318e admin admin] Request method failure captured: Jun 16 22:54:22.562093 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 16 22:54:22.562093 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: Accept: application/json Jun 16 22:54:22.562093 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: Accept-Encoding: gzip, deflate Jun 16 22:54:22.562093 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: Connection: keep-alive Jun 16 22:54:22.562093 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: Content-Length: 0 Jun 16 22:54:22.562093 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: Host: 10.222.0.17 Jun 16 22:54:22.562093 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: Openstack-Api-Version: compute 2.90 Jun 16 22:54:22.562093 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: Openstack-System-Scope: None Jun 16 22:54:22.562093 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: User-Agent: python-novaclient Jun 16 22:54:22.562093 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: X-Auth-Token: gAAAAABiq7SeLAj-cu5EfGvRVSm5IkZBuq_-w2Lr81FTwczB1UDbU-9hafOQzpltk-MsS7DaEhNBzOQHogL5ZaDJVmkcwQsRYmSFggnyV8SxzBdYaNLa6la2Hi4-sMvOdDMSxqhcQfAPE3rSfWy0zwN6IbsWq7GRy7cSI7CdWWwARflcxUjjpNY Jun 16 22:54:22.562093 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: X-Domain-Id: None Jun 16 22:54:22.562093 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: X-Domain-Name: None Jun 16 22:54:22.562093 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: X-Identity-Status: Confirmed Jun 16 22:54:22.562093 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: X-Is-Admin-Project: True Jun 16 22:54:22.562093 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: X-Openstack-Nova-Api-Version: 2.90 Jun 16 22:54:22.562093 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: X-Project-Domain-Id: default Jun 16 22:54:22.562093 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: X-Project-Domain-Name: Default Jun 16 22:54:22.562093 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: X-Project-Id: 2ffbb7bcd828426c857e7fce279519f7 Jun 16 22:54:22.562093 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: X-Project-Name: admin Jun 16 22:54:22.562093 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: X-Role: reader,member,admin Jun 16 22:54:22.562093 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: X-Roles: reader,member,admin Jun 16 22:54:22.563616 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/2ffbb7bcd828426c857e7fce279519f7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_2ffbb7bcd828426c857e7fce279519f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2ffbb7bcd828426c857e7fce279519f7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2ffbb7bcd828426c857e7fce279519f7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Jun 16 22:54:22.563616 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: X-Tenant: admin Jun 16 22:54:22.563616 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: X-Tenant-Id: 2ffbb7bcd828426c857e7fce279519f7 Jun 16 22:54:22.563616 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: X-Tenant-Name: admin Jun 16 22:54:22.563616 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: X-User: admin Jun 16 22:54:22.563616 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: X-User-Domain-Id: default Jun 16 22:54:22.563616 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: X-User-Domain-Name: Default Jun 16 22:54:22.563616 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: X-User-Id: 1288d3a7956c42f7ad18e2e126c7dd07 Jun 16 22:54:22.563616 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: X-User-Name: admin Jun 16 22:54:22.563616 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: method: > Jun 16 22:54:22.563616 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: exception: Flavor 84 could not be found. Jun 16 22:54:22.563616 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: action_args: {'id': '84'} Jun 16 22:54:22.563616 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: {{(pid=103023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 22:54:22.563616 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 22:54:22.564561 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 16 22:54:22.564561 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 16 22:54:22.564561 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 16 22:54:22.564561 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 16 22:54:22.564561 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 22:54:22.564561 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 22:54:22.564561 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 16 22:54:22.564561 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 16 22:54:22.564561 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 16 22:54:22.564561 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 22:54:22.564561 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 16 22:54:22.564561 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 16 22:54:22.564561 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 16 22:54:22.564561 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi Jun 16 22:54:22.564561 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 22:54:22.564561 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi Jun 16 22:54:22.564561 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 22:54:22.564561 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 22:54:22.564561 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 22:54:22.565829 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 22:54:22.565829 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 22:54:22.565829 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 22:54:22.565829 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 22:54:22.565829 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 16 22:54:22.565829 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 16 22:54:22.565829 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 16 22:54:22.565829 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi Jun 16 22:54:22.565829 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 22:54:22.565829 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi Jun 16 22:54:22.565829 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 22:54:22.565829 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 22:54:22.565829 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 22:54:22.565829 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 22:54:22.565829 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 22:54:22.565829 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 16 22:54:22.565829 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi Jun 16 22:54:22.565829 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi [None req-9c39a3a8-a7eb-40bb-b5ac-fba28426318e admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103023) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 22:54:22.567130 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: INFO nova.api.openstack.requestlog [None req-9c39a3a8-a7eb-40bb-b5ac-fba28426318e admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011744 Jun 16 22:54:22.567130 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: [pid: 103023|app: 0|req: 23/47] 10.222.0.17 () {60 vars in 1190 bytes} [Thu Jun 16 22:54:22 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 16 22:54:23.416968 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi [None req-93520189-56ab-4dcc-aeeb-76356627ab49 admin admin] Calling method '>' {{(pid=103024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 22:54:23.417978 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: INFO nova.api.openstack.requestlog [None req-93520189-56ab-4dcc-aeeb-76356627ab49 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Jun 16 22:54:23.418379 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: [pid: 103024|app: 0|req: 25/48] 10.222.0.17 () {56 vars in 1074 bytes} [Thu Jun 16 22:54:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 22:54:23.613849 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi [None req-d40b6559-3fda-4196-b2b1-76138c62cf19 admin admin] Calling method '>' {{(pid=103023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 22:54:23.619659 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: INFO nova.api.openstack.wsgi [None req-d40b6559-3fda-4196-b2b1-76138c62cf19 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 16 22:54:23.621201 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi [None req-d40b6559-3fda-4196-b2b1-76138c62cf19 admin admin] Request method failure captured: Jun 16 22:54:23.621201 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 16 22:54:23.621201 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: Accept: application/json Jun 16 22:54:23.621201 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: Accept-Encoding: gzip, deflate Jun 16 22:54:23.621201 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: Connection: keep-alive Jun 16 22:54:23.621201 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: Content-Length: 0 Jun 16 22:54:23.621201 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: Host: 10.222.0.17 Jun 16 22:54:23.621201 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: Openstack-Api-Version: compute 2.90 Jun 16 22:54:23.621201 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: Openstack-System-Scope: None Jun 16 22:54:23.621201 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: User-Agent: python-novaclient Jun 16 22:54:23.621201 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: X-Auth-Token: gAAAAABiq7SfVcSrJrZ4wS7ACzUViUt35dy9B9U4siSHeuORkVXtY5Ny-Od6MPBTrSxtsuZU5LitNmW5BtObp-RDinaAWYo-MLY7BC0lKJpAYWrliE4YcroVuu5NSPFnzdyfEL7DdjcOE5dUxRmAyKoWrmkPvcjjtAeYGidnIyhDzyYG5uDt2Zw Jun 16 22:54:23.621201 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: X-Domain-Id: None Jun 16 22:54:23.621201 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: X-Domain-Name: None Jun 16 22:54:23.621201 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: X-Identity-Status: Confirmed Jun 16 22:54:23.621201 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: X-Is-Admin-Project: True Jun 16 22:54:23.621201 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: X-Openstack-Nova-Api-Version: 2.90 Jun 16 22:54:23.621201 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: X-Project-Domain-Id: default Jun 16 22:54:23.621201 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: X-Project-Domain-Name: Default Jun 16 22:54:23.621201 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: X-Project-Id: 2ffbb7bcd828426c857e7fce279519f7 Jun 16 22:54:23.621201 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: X-Project-Name: admin Jun 16 22:54:23.621201 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: X-Role: reader,member,admin Jun 16 22:54:23.621201 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: X-Roles: reader,member,admin Jun 16 22:54:23.623247 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/2ffbb7bcd828426c857e7fce279519f7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_2ffbb7bcd828426c857e7fce279519f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2ffbb7bcd828426c857e7fce279519f7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2ffbb7bcd828426c857e7fce279519f7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Jun 16 22:54:23.623247 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: X-Tenant: admin Jun 16 22:54:23.623247 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: X-Tenant-Id: 2ffbb7bcd828426c857e7fce279519f7 Jun 16 22:54:23.623247 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: X-Tenant-Name: admin Jun 16 22:54:23.623247 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: X-User: admin Jun 16 22:54:23.623247 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: X-User-Domain-Id: default Jun 16 22:54:23.623247 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: X-User-Domain-Name: Default Jun 16 22:54:23.623247 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: X-User-Id: 1288d3a7956c42f7ad18e2e126c7dd07 Jun 16 22:54:23.623247 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: X-User-Name: admin Jun 16 22:54:23.623247 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: method: > Jun 16 22:54:23.623247 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: exception: Flavor 451 could not be found. Jun 16 22:54:23.623247 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: action_args: {'id': '451'} Jun 16 22:54:23.623247 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: {{(pid=103023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 22:54:23.623247 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 22:54:23.625180 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 16 22:54:23.625180 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 16 22:54:23.625180 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 16 22:54:23.625180 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 16 22:54:23.625180 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 22:54:23.625180 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 22:54:23.625180 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 16 22:54:23.625180 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 16 22:54:23.625180 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 16 22:54:23.625180 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 22:54:23.625180 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 16 22:54:23.625180 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 16 22:54:23.625180 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 16 22:54:23.625180 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi Jun 16 22:54:23.625180 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 22:54:23.625180 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi Jun 16 22:54:23.625180 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 22:54:23.625180 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 22:54:23.625180 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 22:54:23.626493 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 22:54:23.626493 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 22:54:23.626493 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 22:54:23.626493 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 22:54:23.626493 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 16 22:54:23.626493 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 16 22:54:23.626493 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 16 22:54:23.626493 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi Jun 16 22:54:23.626493 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 22:54:23.626493 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi Jun 16 22:54:23.626493 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 22:54:23.626493 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 22:54:23.626493 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 22:54:23.626493 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 22:54:23.626493 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 22:54:23.626493 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 16 22:54:23.626493 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi Jun 16 22:54:23.626493 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi [None req-d40b6559-3fda-4196-b2b1-76138c62cf19 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103023) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 22:54:23.627738 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: INFO nova.api.openstack.requestlog [None req-d40b6559-3fda-4196-b2b1-76138c62cf19 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.069171 Jun 16 22:54:23.627738 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: [pid: 103023|app: 0|req: 24/49] 10.222.0.17 () {60 vars in 1193 bytes} [Thu Jun 16 22:54:23 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 16 22:54:23.632561 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi [None req-5c8858b9-7992-44f7-93eb-af1fe64f05b1 admin admin] Calling method '>' {{(pid=103024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 22:54:23.648066 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: INFO nova.api.openstack.requestlog [None req-5c8858b9-7992-44f7-93eb-af1fe64f05b1 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019017 Jun 16 22:54:23.648583 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: [pid: 103024|app: 0|req: 26/50] 10.222.0.17 () {60 vars in 1210 bytes} [Thu Jun 16 22:54:23 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 22:54:23.657787 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi [None req-354495d4-b2e8-4540-bf3d-53550ec32858 admin admin] Calling method '>' {{(pid=103023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 22:54:23.671021 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: INFO nova.api.openstack.requestlog [None req-354495d4-b2e8-4540-bf3d-53550ec32858 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016698 Jun 16 22:54:23.671529 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: [pid: 103023|app: 0|req: 25/51] 10.222.0.17 () {60 vars in 1210 bytes} [Thu Jun 16 22:54:23 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 22:54:23.680384 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi [None req-905aefff-aeab-4a14-b1f6-dbc94bbc1a92 admin admin] Calling method '>' {{(pid=103024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 22:54:23.686211 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: INFO nova.api.openstack.wsgi [None req-905aefff-aeab-4a14-b1f6-dbc94bbc1a92 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 16 22:54:23.687724 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi [None req-905aefff-aeab-4a14-b1f6-dbc94bbc1a92 admin admin] Request method failure captured: Jun 16 22:54:23.687724 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 16 22:54:23.687724 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: Accept: application/json Jun 16 22:54:23.687724 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: Accept-Encoding: gzip, deflate Jun 16 22:54:23.687724 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: Connection: keep-alive Jun 16 22:54:23.687724 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: Content-Length: 0 Jun 16 22:54:23.687724 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: Host: 10.222.0.17 Jun 16 22:54:23.687724 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: Openstack-Api-Version: compute 2.90 Jun 16 22:54:23.687724 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: Openstack-System-Scope: None Jun 16 22:54:23.687724 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: User-Agent: python-novaclient Jun 16 22:54:23.687724 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: X-Auth-Token: gAAAAABiq7SfVcSrJrZ4wS7ACzUViUt35dy9B9U4siSHeuORkVXtY5Ny-Od6MPBTrSxtsuZU5LitNmW5BtObp-RDinaAWYo-MLY7BC0lKJpAYWrliE4YcroVuu5NSPFnzdyfEL7DdjcOE5dUxRmAyKoWrmkPvcjjtAeYGidnIyhDzyYG5uDt2Zw Jun 16 22:54:23.687724 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: X-Domain-Id: None Jun 16 22:54:23.687724 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: X-Domain-Name: None Jun 16 22:54:23.687724 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: X-Identity-Status: Confirmed Jun 16 22:54:23.687724 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: X-Is-Admin-Project: True Jun 16 22:54:23.687724 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: X-Openstack-Nova-Api-Version: 2.90 Jun 16 22:54:23.687724 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: X-Project-Domain-Id: default Jun 16 22:54:23.687724 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: X-Project-Domain-Name: Default Jun 16 22:54:23.687724 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: X-Project-Id: 2ffbb7bcd828426c857e7fce279519f7 Jun 16 22:54:23.687724 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: X-Project-Name: admin Jun 16 22:54:23.687724 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: X-Role: reader,member,admin Jun 16 22:54:23.687724 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: X-Roles: reader,member,admin Jun 16 22:54:23.689167 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/2ffbb7bcd828426c857e7fce279519f7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_2ffbb7bcd828426c857e7fce279519f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2ffbb7bcd828426c857e7fce279519f7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2ffbb7bcd828426c857e7fce279519f7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Jun 16 22:54:23.689167 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: X-Tenant: admin Jun 16 22:54:23.689167 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: X-Tenant-Id: 2ffbb7bcd828426c857e7fce279519f7 Jun 16 22:54:23.689167 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: X-Tenant-Name: admin Jun 16 22:54:23.689167 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: X-User: admin Jun 16 22:54:23.689167 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: X-User-Domain-Id: default Jun 16 22:54:23.689167 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: X-User-Domain-Name: Default Jun 16 22:54:23.689167 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: X-User-Id: 1288d3a7956c42f7ad18e2e126c7dd07 Jun 16 22:54:23.689167 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: X-User-Name: admin Jun 16 22:54:23.689167 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: method: > Jun 16 22:54:23.689167 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: exception: Flavor 451 could not be found. Jun 16 22:54:23.689167 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: action_args: {'id': '451'} Jun 16 22:54:23.689167 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: {{(pid=103024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 22:54:23.689167 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 22:54:23.690948 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 16 22:54:23.690948 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 16 22:54:23.690948 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 16 22:54:23.690948 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 16 22:54:23.690948 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 22:54:23.690948 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 22:54:23.690948 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 16 22:54:23.690948 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 16 22:54:23.690948 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 16 22:54:23.690948 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 22:54:23.690948 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 16 22:54:23.690948 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 16 22:54:23.690948 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 16 22:54:23.690948 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi Jun 16 22:54:23.690948 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 22:54:23.690948 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi Jun 16 22:54:23.690948 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 22:54:23.690948 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 22:54:23.690948 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 22:54:23.691951 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 22:54:23.691951 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 22:54:23.691951 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 22:54:23.691951 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 22:54:23.691951 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 16 22:54:23.691951 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 16 22:54:23.691951 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 16 22:54:23.691951 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi Jun 16 22:54:23.691951 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 22:54:23.691951 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi Jun 16 22:54:23.691951 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 22:54:23.691951 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 22:54:23.691951 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 22:54:23.691951 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 22:54:23.691951 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 22:54:23.691951 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 16 22:54:23.691951 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi Jun 16 22:54:23.691951 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi [None req-905aefff-aeab-4a14-b1f6-dbc94bbc1a92 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103024) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 22:54:23.692962 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: INFO nova.api.openstack.requestlog [None req-905aefff-aeab-4a14-b1f6-dbc94bbc1a92 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012117 Jun 16 22:54:23.692962 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: [pid: 103024|app: 0|req: 27/52] 10.222.0.17 () {60 vars in 1193 bytes} [Thu Jun 16 22:54:23 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 16 22:54:24.540991 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi [None req-354495d4-b2e8-4540-bf3d-53550ec32858 admin admin] Calling method '>' {{(pid=103023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 22:54:24.542001 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: INFO nova.api.openstack.requestlog [None req-354495d4-b2e8-4540-bf3d-53550ec32858 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001420 Jun 16 22:54:24.542387 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: [pid: 103023|app: 0|req: 26/53] 10.222.0.17 () {56 vars in 1074 bytes} [Thu Jun 16 22:54:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 22:54:24.730461 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi [None req-63cc6942-69c7-45db-befb-51fed4f9728f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 22:54:24.748518 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: INFO nova.api.openstack.requestlog [None req-63cc6942-69c7-45db-befb-51fed4f9728f admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.068544 Jun 16 22:54:24.749050 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: [pid: 103024|app: 0|req: 28/54] 10.222.0.17 () {64 vars in 1235 bytes} [Thu Jun 16 22:54:24 2022] POST /compute/v2.1/flavors => generated 404 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 22:54:25.608872 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi [None req-354495d4-b2e8-4540-bf3d-53550ec32858 admin admin] Calling method '>' {{(pid=103023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 22:54:25.609915 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: INFO nova.api.openstack.requestlog [None req-354495d4-b2e8-4540-bf3d-53550ec32858 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Jun 16 22:54:25.610313 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: [pid: 103023|app: 0|req: 27/55] 10.222.0.17 () {56 vars in 1074 bytes} [Thu Jun 16 22:54:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 22:54:25.800054 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi [None req-1700f173-e0e1-4e74-ba87-348a1e940fe5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 22:54:25.816761 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: INFO nova.api.openstack.requestlog [None req-1700f173-e0e1-4e74-ba87-348a1e940fe5 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.067910 Jun 16 22:54:25.817296 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: [pid: 103024|app: 0|req: 29/56] 10.222.0.17 () {64 vars in 1235 bytes} [Thu Jun 16 22:54:25 2022] POST /compute/v2.1/flavors => generated 405 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 22:54:26.685128 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi [None req-354495d4-b2e8-4540-bf3d-53550ec32858 admin admin] Calling method '>' {{(pid=103023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 22:54:26.686144 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: INFO nova.api.openstack.requestlog [None req-354495d4-b2e8-4540-bf3d-53550ec32858 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001423 Jun 16 22:54:26.686538 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: [pid: 103023|app: 0|req: 28/57] 10.222.0.17 () {56 vars in 1074 bytes} [Thu Jun 16 22:54:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 22:54:26.874486 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi [None req-10196589-5376-463b-a46d-aed3801ce59a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 22:54:26.891904 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: INFO nova.api.openstack.requestlog [None req-10196589-5376-463b-a46d-aed3801ce59a admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.067884 Jun 16 22:54:26.892388 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: [pid: 103024|app: 0|req: 30/58] 10.222.0.17 () {64 vars in 1235 bytes} [Thu Jun 16 22:54:26 2022] POST /compute/v2.1/flavors => generated 407 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 22:54:27.776933 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi [None req-354495d4-b2e8-4540-bf3d-53550ec32858 admin admin] Calling method '>' {{(pid=103023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 22:54:27.778503 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: INFO nova.api.openstack.requestlog [None req-354495d4-b2e8-4540-bf3d-53550ec32858 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Jun 16 22:54:27.779075 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: [pid: 103023|app: 0|req: 29/59] 10.222.0.17 () {56 vars in 1074 bytes} [Thu Jun 16 22:54:27 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 22:54:27.969366 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi [None req-ecf5a2ff-d216-4407-8fd5-ec3d74eb97f2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 22:54:27.987326 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: INFO nova.api.openstack.requestlog [None req-ecf5a2ff-d216-4407-8fd5-ec3d74eb97f2 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.070584 Jun 16 22:54:27.987790 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: [pid: 103024|app: 0|req: 31/60] 10.222.0.17 () {64 vars in 1235 bytes} [Thu Jun 16 22:54:27 2022] POST /compute/v2.1/flavors => generated 409 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 16 22:54:28.849117 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi [None req-354495d4-b2e8-4540-bf3d-53550ec32858 admin admin] Calling method '>' {{(pid=103023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 22:54:28.850132 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: INFO nova.api.openstack.requestlog [None req-354495d4-b2e8-4540-bf3d-53550ec32858 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001420 Jun 16 22:54:28.850531 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: [pid: 103023|app: 0|req: 30/61] 10.222.0.17 () {56 vars in 1074 bytes} [Thu Jun 16 22:54:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 22:54:29.038719 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi [None req-a75e4ba9-ef81-46f3-aafa-ff89c46f39ba admin admin] Calling method '>' {{(pid=103024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 22:54:29.057591 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: INFO nova.api.openstack.requestlog [None req-a75e4ba9-ef81-46f3-aafa-ff89c46f39ba admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.070488 Jun 16 22:54:29.058175 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: [pid: 103024|app: 0|req: 32/62] 10.222.0.17 () {60 vars in 1202 bytes} [Thu Jun 16 22:54:28 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 22:55:16.503273 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi [None req-354495d4-b2e8-4540-bf3d-53550ec32858 admin admin] Calling method '>' {{(pid=103023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 22:55:16.504235 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: INFO nova.api.openstack.requestlog [None req-354495d4-b2e8-4540-bf3d-53550ec32858 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Jun 16 22:55:16.504631 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: [pid: 103023|app: 0|req: 31/63] 10.222.0.17 () {54 vars in 930 bytes} [Thu Jun 16 22:55:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 22:55:16.515089 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG dbcounter [-] [103024] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 22:55:16.563142 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi [None req-00831eaf-3f47-46ec-a247-00fa9c683a81 admin admin] Calling method '>' {{(pid=103024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 22:55:16.581842 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: INFO nova.api.openstack.requestlog [None req-00831eaf-3f47-46ec-a247-00fa9c683a81 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.071495 Jun 16 22:55:16.582376 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: [pid: 103024|app: 0|req: 33/64] 10.222.0.17 () {60 vars in 1291 bytes} [Thu Jun 16 22:55:16 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 22:55:16.605333 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi [None req-be853c5e-4863-4111-9d92-66fbeddc8c43 admin admin] Calling method '>' {{(pid=103023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 22:55:16.608791 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG dbcounter [-] [103023] Writing DB stats nova_api:SELECT=14 {{(pid=103023) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 22:55:16.614025 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: INFO nova.api.openstack.requestlog [None req-be853c5e-4863-4111-9d92-66fbeddc8c43 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012249 Jun 16 22:55:16.614538 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: [pid: 103023|app: 0|req: 32/65] 10.222.0.17 () {60 vars in 1282 bytes} [Thu Jun 16 22:55:16 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 22:55:16.626391 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi [None req-75f20d48-bc7c-4218-adc1-be60cf2b6dd9 admin admin] Calling method '>' {{(pid=103024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 22:55:16.633881 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: INFO nova.api.openstack.requestlog [None req-75f20d48-bc7c-4218-adc1-be60cf2b6dd9 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010943 Jun 16 22:55:16.634393 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: [pid: 103024|app: 0|req: 34/66] 10.222.0.17 () {60 vars in 1285 bytes} [Thu Jun 16 22:55:16 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 22:55:16.645669 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi [None req-c5ae299a-1fc2-403a-9da4-ff4f3044c58f admin admin] Calling method '>' {{(pid=103023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 22:55:16.655835 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: INFO nova.api.openstack.requestlog [None req-c5ae299a-1fc2-403a-9da4-ff4f3044c58f admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013484 Jun 16 22:55:16.656601 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: [pid: 103023|app: 0|req: 33/67] 10.222.0.17 () {60 vars in 1285 bytes} [Thu Jun 16 22:55:16 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 22:55:16.668407 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi [None req-26d15a77-902f-42a4-b5bd-12c5f92372d1 admin admin] Calling method '>' {{(pid=103024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 22:55:16.675963 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: INFO nova.api.openstack.requestlog [None req-26d15a77-902f-42a4-b5bd-12c5f92372d1 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011040 Jun 16 22:55:16.676471 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: [pid: 103024|app: 0|req: 35/68] 10.222.0.17 () {60 vars in 1282 bytes} [Thu Jun 16 22:55:16 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 22:58:32.361663 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi [None req-c5ae299a-1fc2-403a-9da4-ff4f3044c58f admin admin] Calling method '>' {{(pid=103023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 22:58:32.362729 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: INFO nova.api.openstack.requestlog [None req-c5ae299a-1fc2-403a-9da4-ff4f3044c58f admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Jun 16 22:58:32.363126 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: [pid: 103023|app: 0|req: 34/69] 10.222.0.17 () {56 vars in 1074 bytes} [Thu Jun 16 22:58:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 22:58:32.520999 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG dbcounter [-] [103024] Writing DB stats nova_api:SELECT=6 {{(pid=103024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 22:58:32.633630 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi [None req-b77345be-6396-42ec-beea-42d1c1afc8ce admin admin] Calling method '>' {{(pid=103024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 22:58:32.634806 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 22:58:32.634806 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: warnings.warn(msg) Jun 16 22:58:32.636067 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG oslo_concurrency.lockutils [None req-b77345be-6396-42ec-beea-42d1c1afc8ce admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 22:58:32.636628 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG oslo_concurrency.lockutils [None req-b77345be-6396-42ec-beea-42d1c1afc8ce admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 22:58:32.637491 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG oslo_concurrency.lockutils [None req-b77345be-6396-42ec-beea-42d1c1afc8ce admin admin] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 22:58:32.637921 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG oslo_concurrency.lockutils [None req-b77345be-6396-42ec-beea-42d1c1afc8ce admin admin] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 22:58:32.671377 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: INFO nova.api.openstack.requestlog [None req-b77345be-6396-42ec-beea-42d1c1afc8ce admin admin] 10.222.0.17 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.152323 Jun 16 22:58:32.671951 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: [pid: 103024|app: 0|req: 36/70] 10.222.0.17 () {60 vars in 1193 bytes} [Thu Jun 16 22:58:32 2022] GET /compute/v2.1/os-services => generated 791 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 22:58:33.561567 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi [None req-c5ae299a-1fc2-403a-9da4-ff4f3044c58f admin admin] Calling method '>' {{(pid=103023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 22:58:33.562613 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: INFO nova.api.openstack.requestlog [None req-c5ae299a-1fc2-403a-9da4-ff4f3044c58f admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Jun 16 22:58:33.563005 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: [pid: 103023|app: 0|req: 35/71] 10.222.0.17 () {56 vars in 1074 bytes} [Thu Jun 16 22:58:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 22:58:33.759673 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi [None req-94ad0401-9d26-43f2-8298-99830dc14514 admin admin] Calling method '>' {{(pid=103024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 22:58:33.760910 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 22:58:33.760910 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: warnings.warn(msg) Jun 16 22:58:33.762210 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG oslo_concurrency.lockutils [None req-94ad0401-9d26-43f2-8298-99830dc14514 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 22:58:33.762750 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG oslo_concurrency.lockutils [None req-94ad0401-9d26-43f2-8298-99830dc14514 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 22:58:33.763622 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG oslo_concurrency.lockutils [None req-94ad0401-9d26-43f2-8298-99830dc14514 admin admin] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 22:58:33.764148 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG oslo_concurrency.lockutils [None req-94ad0401-9d26-43f2-8298-99830dc14514 admin admin] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 22:58:33.783712 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: INFO nova.api.openstack.requestlog [None req-94ad0401-9d26-43f2-8298-99830dc14514 admin admin] 10.222.0.17 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.078365 Jun 16 22:58:33.784772 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: [pid: 103024|app: 0|req: 37/72] 10.222.0.17 () {60 vars in 1193 bytes} [Thu Jun 16 22:58:33 2022] GET /compute/v2.1/os-services => generated 791 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 22:58:45.064529 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi [None req-c5ae299a-1fc2-403a-9da4-ff4f3044c58f admin admin] Calling method '>' {{(pid=103023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 22:58:45.066107 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: INFO nova.api.openstack.requestlog [None req-c5ae299a-1fc2-403a-9da4-ff4f3044c58f admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 Jun 16 22:58:45.066509 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: [pid: 103023|app: 0|req: 36/73] 10.222.0.17 () {56 vars in 1074 bytes} [Thu Jun 16 22:58:45 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 22:58:45.209050 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG dbcounter [-] [103024] Writing DB stats nova_cell0:SELECT=4 {{(pid=103024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 22:58:45.209769 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG dbcounter [-] [103024] Writing DB stats nova_cell1:SELECT=4 {{(pid=103024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 22:58:45.210672 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG dbcounter [-] [103024] Writing DB stats nova_api:SELECT=8 {{(pid=103024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 22:58:45.258724 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi [None req-1c263e07-99f1-43dc-b10c-a313408098b2 admin admin] Calling method '>' {{(pid=103024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 22:58:45.259890 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 22:58:45.259890 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: warnings.warn(msg) Jun 16 22:58:45.261076 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG oslo_concurrency.lockutils [None req-1c263e07-99f1-43dc-b10c-a313408098b2 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 22:58:45.261518 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG oslo_concurrency.lockutils [None req-1c263e07-99f1-43dc-b10c-a313408098b2 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 22:58:45.262301 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG oslo_concurrency.lockutils [None req-1c263e07-99f1-43dc-b10c-a313408098b2 admin admin] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 22:58:45.262768 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG oslo_concurrency.lockutils [None req-1c263e07-99f1-43dc-b10c-a313408098b2 admin admin] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 22:58:45.288003 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: INFO nova.api.openstack.requestlog [None req-1c263e07-99f1-43dc-b10c-a313408098b2 admin admin] 10.222.0.17 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.083863 Jun 16 22:58:45.288489 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: [pid: 103024|app: 0|req: 38/74] 10.222.0.17 () {60 vars in 1193 bytes} [Thu Jun 16 22:58:45 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 22:58:46.156040 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi [None req-c5ae299a-1fc2-403a-9da4-ff4f3044c58f admin admin] Calling method '>' {{(pid=103023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 22:58:46.157093 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: INFO nova.api.openstack.requestlog [None req-c5ae299a-1fc2-403a-9da4-ff4f3044c58f admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Jun 16 22:58:46.157483 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: [pid: 103023|app: 0|req: 37/75] 10.222.0.17 () {56 vars in 1074 bytes} [Thu Jun 16 22:58:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 22:58:46.346042 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi [None req-ea312685-345a-4f6d-85ae-3c2c3585aa1f admin admin] Calling method '>' {{(pid=103024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 22:58:46.347959 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 22:58:46.347959 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: warnings.warn(msg) Jun 16 22:58:46.349274 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG oslo_concurrency.lockutils [None req-ea312685-345a-4f6d-85ae-3c2c3585aa1f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 22:58:46.349789 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG oslo_concurrency.lockutils [None req-ea312685-345a-4f6d-85ae-3c2c3585aa1f admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 22:58:46.350570 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG oslo_concurrency.lockutils [None req-ea312685-345a-4f6d-85ae-3c2c3585aa1f admin admin] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 22:58:46.351118 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: DEBUG oslo_concurrency.lockutils [None req-ea312685-345a-4f6d-85ae-3c2c3585aa1f admin admin] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 22:58:46.372488 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: INFO nova.api.openstack.requestlog [None req-ea312685-345a-4f6d-85ae-3c2c3585aa1f admin admin] 10.222.0.17 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.077181 Jun 16 22:58:46.373033 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: [pid: 103024|app: 0|req: 39/76] 10.222.0.17 () {60 vars in 1193 bytes} [Thu Jun 16 22:58:46 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 22:59:42.735418 dv-cinder-846230-1-iscsi devstack@n-api.service[103022]: Thu Jun 16 22:59:42 2022 - graceful shutdown triggered... Jun 16 22:59:42.735177 dv-cinder-846230-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jun 16 22:59:42.736406 dv-cinder-846230-1-iscsi devstack@n-api.service[103023]: Gracefully killing worker 1 (pid: 103023)... Jun 16 22:59:42.736774 dv-cinder-846230-1-iscsi devstack@n-api.service[103024]: Gracefully killing worker 2 (pid: 103024)... Jun 16 22:59:43.736206 dv-cinder-846230-1-iscsi devstack@n-api.service[103022]: worker 1 buried after 1 seconds Jun 16 22:59:43.736742 dv-cinder-846230-1-iscsi devstack@n-api.service[103022]: worker 2 buried after 1 seconds Jun 16 22:59:43.736742 dv-cinder-846230-1-iscsi devstack@n-api.service[103022]: goodbye to uWSGI. Jun 16 22:59:43.737809 dv-cinder-846230-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jun 16 22:59:43.738352 dv-cinder-846230-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jun 16 22:59:43.741494 dv-cinder-846230-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 16 22:59:43.750713 dv-cinder-846230-1-iscsi devstack@n-api.service[117546]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 16 22:59:43.753309 dv-cinder-846230-1-iscsi devstack@n-api.service[117546]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jun 16 22:59:43 2022] *** Jun 16 22:59:43.753309 dv-cinder-846230-1-iscsi devstack@n-api.service[117546]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 16 22:59:43.753309 dv-cinder-846230-1-iscsi devstack@n-api.service[117546]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 16 22:59:43.753309 dv-cinder-846230-1-iscsi devstack@n-api.service[117546]: nodename: dv-cinder-846230-1-iscsi Jun 16 22:59:43.753309 dv-cinder-846230-1-iscsi devstack@n-api.service[117546]: machine: x86_64 Jun 16 22:59:43.753309 dv-cinder-846230-1-iscsi devstack@n-api.service[117546]: clock source: unix Jun 16 22:59:43.753309 dv-cinder-846230-1-iscsi devstack@n-api.service[117546]: pcre jit disabled Jun 16 22:59:43.753309 dv-cinder-846230-1-iscsi devstack@n-api.service[117546]: detected number of CPU cores: 4 Jun 16 22:59:43.753309 dv-cinder-846230-1-iscsi devstack@n-api.service[117546]: current working directory: / Jun 16 22:59:43.753309 dv-cinder-846230-1-iscsi devstack@n-api.service[117546]: detected binary path: /usr/bin/uwsgi-core Jun 16 22:59:43.753975 dv-cinder-846230-1-iscsi devstack@n-api.service[117546]: your processes number limit is 47680 Jun 16 22:59:43.753975 dv-cinder-846230-1-iscsi devstack@n-api.service[117546]: your memory page size is 4096 bytes Jun 16 22:59:43.753975 dv-cinder-846230-1-iscsi devstack@n-api.service[117546]: detected max file descriptor number: 2048 Jun 16 22:59:43.753975 dv-cinder-846230-1-iscsi devstack@n-api.service[117546]: lock engine: pthread robust mutexes Jun 16 22:59:43.753975 dv-cinder-846230-1-iscsi devstack@n-api.service[117546]: thunder lock: enabled Jun 16 22:59:43.753975 dv-cinder-846230-1-iscsi devstack@n-api.service[117546]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 16 22:59:43.753975 dv-cinder-846230-1-iscsi devstack@n-api.service[117546]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 16 22:59:43.798472 dv-cinder-846230-1-iscsi devstack@n-api.service[117546]: Python main interpreter initialized at 0x5582729399c0 Jun 16 22:59:43.798472 dv-cinder-846230-1-iscsi devstack@n-api.service[117546]: python threads support enabled Jun 16 22:59:43.798472 dv-cinder-846230-1-iscsi devstack@n-api.service[117546]: your server socket listen backlog is limited to 100 connections Jun 16 22:59:43.798472 dv-cinder-846230-1-iscsi devstack@n-api.service[117546]: your mercy for graceful operations on workers is 90 seconds Jun 16 22:59:43.799032 dv-cinder-846230-1-iscsi devstack@n-api.service[117546]: mapped 403077 bytes (393 KB) for 2 cores Jun 16 22:59:43.799032 dv-cinder-846230-1-iscsi devstack@n-api.service[117546]: *** Operational MODE: preforking *** Jun 16 22:59:43.799273 dv-cinder-846230-1-iscsi devstack@n-api.service[117546]: *** uWSGI is running in multiple interpreter mode *** Jun 16 22:59:43.799273 dv-cinder-846230-1-iscsi devstack@n-api.service[117546]: spawned uWSGI master process (pid: 117546) Jun 16 22:59:43.799432 dv-cinder-846230-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 16 22:59:43.802469 dv-cinder-846230-1-iscsi devstack@n-api.service[117546]: spawned uWSGI worker 1 (pid: 117562, cores: 1) Jun 16 22:59:43.802469 dv-cinder-846230-1-iscsi devstack@n-api.service[117546]: spawned uWSGI worker 2 (pid: 117563, cores: 1) Jun 16 22:59:43.802469 dv-cinder-846230-1-iscsi devstack@n-api.service[117546]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 16 22:59:44.454667 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 16 22:59:44.475583 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 16 22:59:45.692471 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 22:59:45.692471 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: from cryptography.utils import int_from_bytes Jun 16 22:59:45.693074 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 22:59:45.693074 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: from cryptography.utils import int_from_bytes Jun 16 22:59:45.716891 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 22:59:45.716891 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: from cryptography.utils import int_from_bytes Jun 16 22:59:45.717482 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 22:59:45.717482 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: from cryptography.utils import int_from_bytes Jun 16 22:59:48.087476 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 16 22:59:48.087887 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 16 22:59:48.088252 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 16 22:59:48.088609 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 16 22:59:48.088864 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 16 22:59:48.089245 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.089568 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.089889 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.090205 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.090533 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.091438 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.091763 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.092081 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.092408 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.092674 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.093000 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.093318 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-846230-1-iscsi {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.093640 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.093944 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.094254 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.094566 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.094892 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.095213 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.095518 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.096007 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.096742 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.097052 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.097516 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.097824 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.098685 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.098685 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.099007 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.099261 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.099589 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.099895 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.100290 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-846230-1-iscsi {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.100609 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.100917 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.101231 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.101647 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.101956 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.102448 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.102797 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.103126 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.103456 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.103769 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.104087 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.104404 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.104718 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.105202 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.105537 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.105895 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.106220 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.107138 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.107446 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.107698 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.108006 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.108331 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.108652 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.108972 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.109225 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.109476 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.109791 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.110108 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.110416 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.110745 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.111052 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.111357 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.111662 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.111966 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.112270 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.112573 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.112887 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.113205 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.113526 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.113830 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.114145 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.114815 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.17 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.115072 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.17 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.115380 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.115715 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.116032 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.116337 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.116652 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.116970 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.117276 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.117579 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.117884 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.118200 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.118534 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.118708 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 16 22:59:48.119154 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.119297 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 16 22:59:48.119431 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.119431 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.119679 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 16 22:59:48.119812 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.119951 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 16 22:59:48.120089 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.120221 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 16 22:59:48.120355 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.120492 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.120642 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.120777 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.120903 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.121115 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.121257 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.121384 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.121519 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.121711 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.121840 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.122045 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.122180 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.122391 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.122530 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.122722 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.122962 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.123271 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.123408 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.123691 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.123830 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.123964 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.124099 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.124225 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.124358 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.124514 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.124711 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-846230-1-iscsi {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.124843 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.124967 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.125136 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.125326 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.125550 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.125681 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.125805 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.125939 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.126071 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.126196 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.126320 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.126443 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.126571 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.126774 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.126902 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.127106 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.127245 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.127397 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.127538 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.127707 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.127836 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.128011 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.128140 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.128313 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.128456 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.128626 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.128766 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.128925 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.129061 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.129227 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.129380 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.129537 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.129667 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.129840 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.129975 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.130142 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.130272 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.130442 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.130580 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-846230-1-iscsi {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.130752 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.130895 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.131056 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.131195 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.131358 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.131490 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.131660 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.131894 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.132026 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.132207 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.132337 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.132547 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.132676 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.132820 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.132959 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.133130 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.133260 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.133434 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.133570 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.133778 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.133917 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.134044 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.134181 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.134353 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.134501 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.134699 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.134889 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.135019 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.135144 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.135304 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.135524 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.135717 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.135846 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.135978 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.136106 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.136240 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.136373 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.136506 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.136642 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.136768 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.136894 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.137027 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.137155 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.137330 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.137460 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.137677 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.137806 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.138000 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.138140 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.138275 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.138402 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.138536 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.138717 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.138854 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.139022 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.139159 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.139337 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.139475 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.139653 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.139789 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.139972 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.140109 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.140283 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.140412 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.140596 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.140724 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.140904 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.141033 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.141211 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.141353 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.141518 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.141654 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.141836 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.141974 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.142153 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.142290 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.142475 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.142712 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.142845 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.142976 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.143109 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.143249 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.143439 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.143567 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.17 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.143736 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.17 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.143942 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.144073 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.144213 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.144346 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.144474 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.144657 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.144793 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.145005 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.145141 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.145274 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.145401 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.145606 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.145756 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.145960 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.146096 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.146232 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.146359 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.146485 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.146664 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.146806 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.146934 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.147125 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.147254 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.147439 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.147568 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.147707 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.147840 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.147991 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.148127 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.148301 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.148437 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.148623 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.148760 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.148937 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.149066 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.149245 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.149388 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.149547 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.149685 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.149847 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.149986 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.150146 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.150283 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.150453 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.150580 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.150779 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.150908 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.151086 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.151290 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.151425 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.151561 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.151694 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.151829 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.151978 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.152121 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.152285 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.152421 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.152591 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.152733 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.152936 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.153067 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.153696 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.153838 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.154055 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.154200 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.154326 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.154459 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.154638 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.154783 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.154944 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.155097 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.155293 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.155421 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.155554 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.155754 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.155891 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.156094 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.156223 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.156359 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.156493 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.156627 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.156761 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.156889 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.157023 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.157149 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.157320 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.157456 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.157628 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.157758 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.157934 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.158064 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.158242 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.158371 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.158561 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.158734 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.158895 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.159040 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.159206 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.159346 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.159514 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.159651 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.159820 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.159957 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.160126 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.160270 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.160432 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.160561 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.160738 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.160866 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.161042 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.161185 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.161339 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.161466 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.161640 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.161768 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.161938 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.162082 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.162240 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.162376 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.162541 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.162766 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.162913 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.163115 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.163245 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.163379 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.163505 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.163630 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 22:59:48.163768 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.163910 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.164036 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.164252 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.164383 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.164507 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.164645 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.164814 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.164950 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.165147 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.165441 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.165573 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.165795 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.165942 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.166155 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.166300 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.166443 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.166580 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.166760 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.166897 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.167090 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.167226 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.167406 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.167549 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.167727 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.167867 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.168034 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.168162 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.168348 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.168493 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.168656 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.168786 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.169508 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.169641 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.169821 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.169964 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.170130 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.170259 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.170449 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.170638 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.170783 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.170911 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.171087 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.171216 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.171394 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.171523 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.171716 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.171854 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.172026 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.172170 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.172343 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.172472 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.172647 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.172778 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.172958 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.173109 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.173299 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.173427 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.173617 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.173754 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.173932 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.174067 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.174286 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.174438 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.174573 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.174720 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.174881 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.175023 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.175191 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.175329 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.175538 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.175683 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.175810 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.176019 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.176146 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.176360 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.176497 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.176632 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.176759 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.176891 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.177018 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.177155 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.177292 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.177428 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.177598 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.177735 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.177911 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.178119 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.178248 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.178373 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.178505 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.178666 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.178857 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.178988 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.179181 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.179315 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.179494 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.179644 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.179856 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.179991 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.180117 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.180248 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.180394 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.180519 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.180699 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.180826 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.181006 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.181135 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.181309 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.181437 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.181609 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.181744 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.181909 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.182045 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.182215 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.182359 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.182525 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.182721 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.182850 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.182986 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.183152 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.183310 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.183508 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.183646 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.183779 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.183904 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.184029 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.184162 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.184430 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.184579 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.184706 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.184831 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.184956 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.185090 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.185257 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.185399 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.185566 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.185767 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.185907 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.186045 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.186238 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.186381 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.186570 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.186735 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.186874 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.186990 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.187114 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.187306 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.187455 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.187632 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.187771 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.187947 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.188076 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.188249 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.188376 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.188563 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.188699 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.188885 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.189021 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.189187 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.189316 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.189499 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.189630 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.189816 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.189952 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.190123 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.190253 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.190432 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.190563 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.190762 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.190892 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.191070 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.191198 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.191387 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.191516 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.191691 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.191818 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.191993 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.192130 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.192297 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.192424 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.192602 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.192730 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.192904 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.193044 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.193209 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.193350 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.193497 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.193683 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.193825 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.193961 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.194094 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.194227 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.194383 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.194624 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.194769 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.194907 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.195041 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.195166 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.195321 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.195451 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.195624 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.195885 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.196032 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.196278 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.196423 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.196571 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.196771 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.196903 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.197035 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.197161 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.197285 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.197431 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.197570 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.197756 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.197887 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.198079 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.198209 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.198414 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.198697 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.198835 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.199019 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.199148 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.199328 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.199456 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.199631 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.199761 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.199940 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.200099 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.200265 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.200961 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.201105 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.201234 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.201367 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.201504 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.201630 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.201762 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.201888 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.202013 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.202138 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.202272 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.202400 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.202533 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.202678 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.202805 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.202930 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.203075 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.203211 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.203338 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.203470 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.203596 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.203814 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.203945 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.204071 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.204205 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.204332 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.204457 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.204612 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.204808 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.204936 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.205069 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.205196 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.205322 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.205540 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.205669 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.205778 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.205903 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.206081 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.206197 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.206332 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.206523 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.206692 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.206901 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.207015 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.207133 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.207242 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.207391 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.207509 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.207740 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.207867 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.208010 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.208126 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.208311 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.208427 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.208618 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.208741 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.208923 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.209039 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.209223 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.209345 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.209531 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.209654 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.209838 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.209962 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.210144 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.210267 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.210451 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.210576 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.210788 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.210921 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.211098 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.211238 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.211412 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.211557 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.211719 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.211848 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.212037 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.213191 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.213191 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.213998 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.214118 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.214246 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.214380 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.214517 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.214702 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.214852 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.215103 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.215242 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.215369 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.215494 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.215621 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.216351 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.216497 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.216692 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.216815 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.217024 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.217160 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.217276 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.217392 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.217508 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.217617 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.217755 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.217903 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.218039 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.218172 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.218289 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.218422 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.218556 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.218710 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.218843 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.218969 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.218969 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.219216 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.219438 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.219567 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.219693 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.219808 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.219924 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.220094 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.220223 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.220357 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.220490 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.220631 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.220830 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.221110 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.221239 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.221372 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.221488 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.221595 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.221734 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.221861 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.221994 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.221994 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.222226 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.222348 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.222486 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.222753 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.222886 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.223011 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.223151 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.223315 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.223443 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.223569 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.223569 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.223812 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.223950 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.224151 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.224282 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.224414 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.224536 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.224645 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.224771 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.224905 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.225054 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.225285 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.225422 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.225547 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.225678 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.225813 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.225940 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.226065 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.226188 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.226320 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.226490 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.226629 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.226827 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.226968 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.227189 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.227330 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.227471 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.227471 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.227718 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.227851 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.227984 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.228117 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.228261 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.228388 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.228388 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.228641 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.228765 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.228874 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.228997 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.229106 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.229247 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.229373 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.229556 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.229720 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.229866 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.229982 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.230185 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.230320 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.230503 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.230644 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.230849 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.230965 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.231150 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.231302 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.232018 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.232136 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.232329 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.232452 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.232636 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.232790 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.232998 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.233128 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.233254 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.233377 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.233571 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.233710 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.233973 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.234288 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.234487 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.234678 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.234855 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.234985 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.235169 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.235388 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.236035 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.236177 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.236315 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.236449 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.236583 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.236711 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.236859 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.237135 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.237352 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.237481 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.237615 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.237751 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.237886 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.238018 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.238144 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.238277 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.238403 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.238528 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.238691 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.238831 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.238958 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.238958 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.239237 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.239372 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.239758 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.239887 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.240019 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.240153 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.240277 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.240415 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.240540 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.240729 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.240865 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.241033 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.241160 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.241341 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.241478 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.241649 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.241788 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.241984 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.242151 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.242289 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.242468 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.242645 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.242806 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.242935 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.243167 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.243313 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.243521 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.243652 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.243833 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.243968 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.244166 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.244448 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.244580 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.244696 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.244828 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.244960 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.245101 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.245228 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.245376 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.245569 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.245697 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.245831 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.245971 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.246098 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.246282 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.246411 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.246612 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.246798 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.246962 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.247180 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.247311 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.247522 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.247662 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.247878 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.248007 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.248185 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.248330 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.248491 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.248624 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.248798 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.248935 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.249109 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.249238 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.249417 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.249546 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.249719 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.249855 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.250033 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.250169 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.250341 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.250470 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.250663 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.250806 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.250973 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.251109 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.251285 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.251422 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.251590 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.251720 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.251888 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.252024 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.252197 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.252338 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.252513 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.252641 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.252823 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.252953 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.253178 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.253329 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.253472 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.253607 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.253733 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.253866 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.254015 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.254153 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.254321 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.254525 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.254702 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.254830 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.254970 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.255098 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.255223 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.255347 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.255524 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.255740 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.255877 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.256004 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.256135 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.256260 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.256427 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.256555 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.256735 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.256873 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.257039 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.257189 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.257376 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.257519 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.257721 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.257855 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.257980 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.258112 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.258239 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.258378 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.258554 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.258718 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.258952 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.259082 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.259271 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.259410 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.259583 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.259712 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.259897 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.260025 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.260212 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.260351 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.260510 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.260646 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.260819 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.260948 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.261123 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.261266 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.261424 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.261561 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.261725 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.261856 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.262025 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.262164 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.262330 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.262458 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.262707 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.262929 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.263072 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.263222 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.263412 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.263549 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.263691 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.263826 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.263968 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.264102 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.264236 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.264370 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.264582 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.264719 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.264854 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.264982 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.265143 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.265273 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.265453 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.265602 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.265820 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.266023 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.266154 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.266280 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.266419 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.266555 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.266730 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.266856 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.266982 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.267121 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.267258 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.267399 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.267595 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.267740 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.267938 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.268082 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.268211 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.268379 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.268508 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.268642 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.268770 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.268904 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.269031 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.269165 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.269301 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.269427 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.269553 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.269691 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.269827 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.269954 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.270123 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.270264 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.270423 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.270568 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.270794 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.270937 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.271095 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.271284 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.271435 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.271599 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.271737 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.271912 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.272042 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.272219 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.272359 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.272532 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.272670 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.272846 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.272975 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.273165 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.273304 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.273507 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.273659 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.273788 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.273922 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.274124 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.274267 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.274436 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.274575 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.274839 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.274975 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.275115 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.275249 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.275376 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.275510 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.275644 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.275770 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.275953 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.276168 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.276307 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.276434 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.276584 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.276799 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.276940 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.277126 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.277256 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.277438 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.277583 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.277772 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.277931 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.278131 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.278797 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.278924 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.279062 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.279199 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.279335 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.279494 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.279631 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.279802 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.280037 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.280179 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.280352 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.280482 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.280665 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.280806 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.280989 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.281133 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.281313 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.281443 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.281638 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.281768 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.281948 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.282086 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.282256 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.282391 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.282564 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.282710 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.282899 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.283029 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.283222 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.283358 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.283536 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.283740 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.283883 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.284016 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.284142 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.284273 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.284444 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.284587 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.284819 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.284961 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.285089 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.285215 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.285347 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.285483 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.285652 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.285783 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.285962 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.286100 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.286313 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.286452 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.286629 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.286773 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.286901 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.287036 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.287172 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.287323 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.287483 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.287614 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.287815 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.287960 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.288116 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.288308 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.288437 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.288563 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.288715 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.288845 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.289027 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.289167 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.289407 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.289544 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.289718 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.289848 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.290027 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.290158 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.290330 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.290461 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.290653 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.290803 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.290976 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.291109 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.291281 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.291411 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.291602 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.291746 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.291916 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.292052 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.292235 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.292367 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.292583 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.292889 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.293077 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.293215 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.293391 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.293535 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.293806 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.294008 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.294144 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.294279 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.294414 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.294542 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.294792 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.295012 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.295158 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.295288 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.295416 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.295597 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.295741 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.295910 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.296047 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.296233 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.296450 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.296580 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.296720 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.296854 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.296981 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.297141 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.297271 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.297457 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.297601 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.297763 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.297907 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.298103 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.298240 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.298454 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.298605 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.298734 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.298874 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.299001 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.299127 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.299261 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.299570 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.299706 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.299879 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.300009 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.300182 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.300328 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.300486 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.300621 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.300785 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.300920 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.301089 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.301238 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.301395 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.301532 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.301694 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.301822 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.301998 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.302135 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.302304 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.302434 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.302643 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.302778 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.302923 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.303059 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.303212 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.303343 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.303512 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.303651 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.303829 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.304029 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.304167 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.304302 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.304430 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.304555 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.304694 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.304821 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.305042 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.305182 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.305316 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.305457 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.305584 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.305710 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.305908 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.306039 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.306225 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.306369 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.306576 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.306738 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.306866 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.307000 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.307128 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.307268 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.307428 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.307565 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.307743 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.307875 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.308049 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.308266 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.308403 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.308609 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.308754 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.308888 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.309027 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.309146 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.309323 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.309514 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.309690 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.309901 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.310218 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.310357 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.310550 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.310715 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.310896 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.311037 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.311180 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.311307 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.311490 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.311666 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.311810 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.311947 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.312087 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.312223 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.312393 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.312523 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.312699 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.312839 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.313006 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.313137 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.313481 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.313621 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.313748 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.313884 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.314025 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.314223 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.314361 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.314497 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.314657 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.314795 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.314930 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.315055 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.315285 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.315413 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.315552 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.315688 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.315814 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.315947 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.316081 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.316215 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.316353 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.316482 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.316685 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.316822 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.316949 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.317085 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.317218 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.317345 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.317479 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.317656 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.317793 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.317974 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.318105 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.318306 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.318450 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.318701 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.318838 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.318979 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.319108 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.319233 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.319365 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.319519 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.319664 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.319836 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.319965 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.320135 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.320263 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.320459 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.320617 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.320823 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.320953 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.321103 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.321240 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.321420 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.321559 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.321737 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.321874 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.322053 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.322191 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.322369 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.322571 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.322740 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.322909 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.323038 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.323243 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.323483 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.323623 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.323751 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.323881 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.324007 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.324257 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.324405 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.324540 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.324667 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.324802 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.324928 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.325658 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.325806 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.325936 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.326061 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.326229 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.326359 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.326539 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.326804 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.326945 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.327072 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.327196 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.327319 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.327457 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.327582 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.327740 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.327868 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.328045 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.328182 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.328428 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.328574 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.328708 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.328920 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.329051 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.329232 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.329378 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.329513 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.329638 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.329812 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.329950 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.330113 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.330251 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.330414 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.330542 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.330737 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.330869 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.331038 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.331178 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.331344 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.331482 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.331645 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.331784 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.331947 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.332077 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.332245 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.332374 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.332547 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.332677 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.332846 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.332984 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.333174 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.333312 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.333482 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.333624 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.333790 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.333920 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.334102 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.334240 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.334455 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.334617 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.334740 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.334871 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.335038 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.335174 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.335351 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.335489 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.335709 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.335847 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.335981 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.336106 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.336240 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.336381 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.336554 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.336682 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.336897 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.337035 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.337175 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.337308 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.337458 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.337596 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.337762 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.337899 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.338068 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.338198 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.338372 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.338513 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.338743 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.338874 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.339089 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.339246 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.339374 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.339510 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.339644 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.339779 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.339913 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.340039 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.340222 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.340360 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.340527 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.341240 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.341377 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.341511 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.341697 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.341824 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.342006 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.342145 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.342315 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.342445 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.342640 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.342784 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.342950 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.343088 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.343258 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.343395 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.343572 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.343810 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.343954 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.344145 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.344275 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.344486 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.344623 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.344791 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.344936 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.345110 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.345248 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.345419 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.345550 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.345729 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.345943 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.346082 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.346210 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.346336 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.346462 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.346661 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.346794 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.347016 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.347162 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.347304 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.347438 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.347573 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.347701 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.347835 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 16 22:59:48.347962 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.348163 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.348478 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.348787 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.349120 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.349393 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.349704 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.350013 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.350321 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.350653 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.350996 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.351315 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.351631 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.351948 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.352705 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.352705 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.352986 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.353164 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.353473 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.353788 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.354119 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.354433 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.354791 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.355212 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.355526 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.355846 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.356172 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.356786 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.357156 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.357438 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.357752 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.358077 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.358391 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.358765 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.359109 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.359442 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.359767 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.360075 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.360385 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.360691 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.361003 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.361325 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.361638 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.361946 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.362250 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.362562 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.362981 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.363217 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.363524 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.363831 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.364139 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.364769 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.365010 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.365315 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.365621 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.365926 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.366231 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.366541 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.366871 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.367267 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.367475 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.367782 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.368084 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.368416 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.368753 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.369070 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.369393 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.369703 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.370025 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.370336 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.370695 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.371019 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.371588 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.371934 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.372292 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.372606 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.372923 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.373238 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.373551 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.373863 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.374174 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.374502 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.374873 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.375160 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.375488 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.375807 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.376128 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.376472 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.376785 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.377113 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.377427 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.377735 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.378052 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.378477 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.378701 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.379021 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.379339 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.379669 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.380078 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.380311 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.380639 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.380967 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.381317 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.381635 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.381981 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.382310 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.382642 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.382955 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.383262 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 22:59:48.383509 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 16 22:59:48.411238 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO dbcounter [None req-eac11ae0-89d8-446c-abf8-ea7cda4c412e None None] Registered counter for database nova_api Jun 16 22:59:48.430745 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_db.sqlalchemy.engines [None req-eac11ae0-89d8-446c-abf8-ea7cda4c412e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117562) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 22:59:48.437221 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG dbcounter [-] [117562] Writer thread running {{(pid=117562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 22:59:48.449239 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO dbcounter [None req-90bd03b0-5a1a-448a-bd4b-ef9e7451fa27 None None] Registered counter for database nova_api Jun 16 22:59:48.469883 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_db.sqlalchemy.engines [None req-90bd03b0-5a1a-448a-bd4b-ef9e7451fa27 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117563) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 22:59:48.476434 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG dbcounter [-] [117563] Writer thread running {{(pid=117563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 22:59:48.494131 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.context [None req-eac11ae0-89d8-446c-abf8-ea7cda4c412e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5f428d07-ff1a-4378-acf2-68efcfdb27a3(cell1) {{(pid=117562) load_cells /opt/stack/nova/nova/context.py:464}} Jun 16 22:59:48.498465 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-eac11ae0-89d8-446c-abf8-ea7cda4c412e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 22:59:48.500144 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-eac11ae0-89d8-446c-abf8-ea7cda4c412e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 22:59:48.501035 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-eac11ae0-89d8-446c-abf8-ea7cda4c412e None None] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 22:59:48.503167 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-eac11ae0-89d8-446c-abf8-ea7cda4c412e None None] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 22:59:48.505169 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO dbcounter [None req-eac11ae0-89d8-446c-abf8-ea7cda4c412e None None] Registered counter for database nova_cell0 Jun 16 22:59:48.509029 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO dbcounter [None req-eac11ae0-89d8-446c-abf8-ea7cda4c412e None None] Registered counter for database nova_cell1 Jun 16 22:59:48.516790 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_db.sqlalchemy.engines [None req-eac11ae0-89d8-446c-abf8-ea7cda4c412e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117562) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 22:59:48.518749 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_db.sqlalchemy.engines [None req-eac11ae0-89d8-446c-abf8-ea7cda4c412e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117562) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 22:59:48.525675 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG dbcounter [-] [117562] Writer thread running {{(pid=117562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 22:59:48.526040 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG dbcounter [-] [117562] Writer thread running {{(pid=117562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 22:59:48.534744 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.context [None req-90bd03b0-5a1a-448a-bd4b-ef9e7451fa27 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5f428d07-ff1a-4378-acf2-68efcfdb27a3(cell1) {{(pid=117563) load_cells /opt/stack/nova/nova/context.py:464}} Jun 16 22:59:48.538843 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-90bd03b0-5a1a-448a-bd4b-ef9e7451fa27 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 22:59:48.540417 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-90bd03b0-5a1a-448a-bd4b-ef9e7451fa27 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 22:59:48.541237 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-90bd03b0-5a1a-448a-bd4b-ef9e7451fa27 None None] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 22:59:48.543263 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-90bd03b0-5a1a-448a-bd4b-ef9e7451fa27 None None] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 22:59:48.545334 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO dbcounter [None req-90bd03b0-5a1a-448a-bd4b-ef9e7451fa27 None None] Registered counter for database nova_cell0 Jun 16 22:59:48.549231 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO dbcounter [None req-90bd03b0-5a1a-448a-bd4b-ef9e7451fa27 None None] Registered counter for database nova_cell1 Jun 16 22:59:48.556398 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_db.sqlalchemy.engines [None req-90bd03b0-5a1a-448a-bd4b-ef9e7451fa27 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117563) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 22:59:48.558695 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_db.sqlalchemy.engines [None req-90bd03b0-5a1a-448a-bd4b-ef9e7451fa27 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117563) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 22:59:48.566142 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG dbcounter [-] [117563] Writer thread running {{(pid=117563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 22:59:48.567420 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG dbcounter [-] [117563] Writer thread running {{(pid=117563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 22:59:48.679920 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO dbcounter [None req-eac11ae0-89d8-446c-abf8-ea7cda4c412e None None] Registered counter for database nova_cell0 Jun 16 22:59:48.688032 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_db.sqlalchemy.engines [None req-eac11ae0-89d8-446c-abf8-ea7cda4c412e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117562) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 22:59:48.693122 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG dbcounter [-] [117562] Writer thread running {{(pid=117562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 22:59:48.717364 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO dbcounter [None req-90bd03b0-5a1a-448a-bd4b-ef9e7451fa27 None None] Registered counter for database nova_cell0 Jun 16 22:59:48.724118 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_db.sqlalchemy.engines [None req-90bd03b0-5a1a-448a-bd4b-ef9e7451fa27 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117563) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 22:59:48.728967 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG dbcounter [-] [117563] Writer thread running {{(pid=117563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 22:59:49.007275 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: WARNING keystonemiddleware.auth_token [None req-eac11ae0-89d8-446c-abf8-ea7cda4c412e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 16 22:59:49.014966 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: WARNING keystonemiddleware.auth_token [None req-eac11ae0-89d8-446c-abf8-ea7cda4c412e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 16 22:59:49.046696 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: WARNING keystonemiddleware.auth_token [None req-90bd03b0-5a1a-448a-bd4b-ef9e7451fa27 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 16 22:59:49.053901 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: WARNING keystonemiddleware.auth_token [None req-90bd03b0-5a1a-448a-bd4b-ef9e7451fa27 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 16 22:59:49.354851 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: WARNING keystonemiddleware.auth_token [None req-eac11ae0-89d8-446c-abf8-ea7cda4c412e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 16 22:59:49.360571 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: WARNING keystonemiddleware.auth_token [None req-eac11ae0-89d8-446c-abf8-ea7cda4c412e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 16 22:59:49.366293 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5582729399c0 pid: 117562 (default app) Jun 16 22:59:49.404369 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: WARNING keystonemiddleware.auth_token [None req-90bd03b0-5a1a-448a-bd4b-ef9e7451fa27 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 16 22:59:49.410326 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: WARNING keystonemiddleware.auth_token [None req-90bd03b0-5a1a-448a-bd4b-ef9e7451fa27 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 16 22:59:49.415615 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5582729399c0 pid: 117563 (default app) Jun 16 23:00:39.598253 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG dbcounter [-] [117562] Writing DB stats nova_api:SELECT=3 {{(pid=117562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 23:00:39.599842 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG dbcounter [-] [117562] Writing DB stats nova_cell0:SELECT=3 {{(pid=117562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 23:00:39.601400 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG dbcounter [-] [117562] Writing DB stats nova_cell1:SELECT=3 {{(pid=117562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 23:00:39.609926 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG dbcounter [-] [117562] Writing DB stats nova_cell0:SELECT=3 {{(pid=117562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 23:00:40.346498 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-45f6a344-c301-4f24-9dfc-2dea3a8c5618 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-896716841", "imageRef": "2b486731-e5ea-4159-b6b1-ed0083e00543", "flavorRef": "452", "networks": [{"uuid": "fa915362-6371-474d-bd5e-1440a44c78bc"}]}} {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 23:00:40.976328 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.network.neutron [None req-45f6a344-c301-4f24-9dfc-2dea3a8c5618 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] validate_networks() for [('fa915362-6371-474d-bd5e-1440a44c78bc', None, None, None, None, None)] {{(pid=117562) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 23:00:42.803895 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.virt.hardware [None req-45f6a344-c301-4f24-9dfc-2dea3a8c5618 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Flavor limits 0:0:0 {{(pid=117562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 23:00:42.808133 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.virt.hardware [None req-45f6a344-c301-4f24-9dfc-2dea3a8c5618 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Image limits 0:0:0 {{(pid=117562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 23:00:42.809009 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.virt.hardware [None req-45f6a344-c301-4f24-9dfc-2dea3a8c5618 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Flavor pref 0:0:0 {{(pid=117562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 23:00:42.809582 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.virt.hardware [None req-45f6a344-c301-4f24-9dfc-2dea3a8c5618 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Image pref 0:0:0 {{(pid=117562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 23:00:42.810167 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.virt.hardware [None req-45f6a344-c301-4f24-9dfc-2dea3a8c5618 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 23:00:42.839621 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-45f6a344-c301-4f24-9dfc-2dea3a8c5618 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:00:42.844989 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-45f6a344-c301-4f24-9dfc-2dea3a8c5618 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:00:42.846226 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-45f6a344-c301-4f24-9dfc-2dea3a8c5618 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:00:42.847491 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-45f6a344-c301-4f24-9dfc-2dea3a8c5618 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:00:42.906836 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.quota [None req-45f6a344-c301-4f24-9dfc-2dea3a8c5618 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Getting quotas for project c2300d78ad8244e3be17c1f388603de7. Resources: {'instances', 'cores', 'ram'} {{(pid=117562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 23:00:42.922185 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.quota [None req-45f6a344-c301-4f24-9dfc-2dea3a8c5618 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Getting quotas for user a4a6c4623c5f471b8241257180b64d37 and project c2300d78ad8244e3be17c1f388603de7. Resources: {'instances', 'cores', 'ram'} {{(pid=117562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 23:00:42.965212 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-45f6a344-c301-4f24-9dfc-2dea3a8c5618 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Going to run 1 instances... {{(pid=117562) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 23:00:42.973314 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-45f6a344-c301-4f24-9dfc-2dea3a8c5618 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] [instance: d40a3e67-031a-4ad7-bd79-7c7d9a3bece9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2b486731-e5ea-4159-b6b1-ed0083e00543',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 23:00:43.214844 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-45f6a344-c301-4f24-9dfc-2dea3a8c5618 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.623847 Jun 16 23:00:43.228985 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 1/1] 10.222.0.17 () {60 vars in 1146 bytes} [Thu Jun 16 23:00:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 3639 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 23:00:43.235793 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG dbcounter [-] [117563] Writing DB stats nova_api:SELECT=3 {{(pid=117563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 23:00:43.236923 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG dbcounter [-] [117563] Writing DB stats nova_cell0:SELECT=3 {{(pid=117563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 23:00:43.237829 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG dbcounter [-] [117563] Writing DB stats nova_cell1:SELECT=3 {{(pid=117563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 23:00:43.242535 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG dbcounter [-] [117563] Writing DB stats nova_cell0:SELECT=3 {{(pid=117563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 23:00:43.416229 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-a7a50637-b153-4a28-91b5-e261014f2655 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Action: 'create', calling method: .version_select at 0x7f532146c5e0>, body: {"keypair": {"name": "tempest-keypair-869930941", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIpQRbnuiGnCiQ4ZT2FEjzYZYLXKu/cS6IZ2AGsZIQmEH8w9+M0yx3ZothxsA4GoQHWb8pPZ0Zuf1m3Wr+Mv/9vJmebyee7JIWsBDVrS3TCP1Wy44q4dtkoQa3NcvmdNRQ=="}} {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 23:00:43.486375 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.quota [None req-a7a50637-b153-4a28-91b5-e261014f2655 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Getting quotas for project f3b1be8431b0434d8bd6abca293127d5. Resources: {'key_pairs'} {{(pid=117562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 23:00:43.495931 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.quota [None req-a7a50637-b153-4a28-91b5-e261014f2655 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Getting quotas for user 6a993f5d14b64fccad723abecfcadf90 and project f3b1be8431b0434d8bd6abca293127d5. Resources: {'key_pairs'} {{(pid=117562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 23:00:43.609245 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-a7a50637-b153-4a28-91b5-e261014f2655 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.348864 Jun 16 23:00:43.611164 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 2/2] 10.222.0.17 () {60 vars in 1158 bytes} [Thu Jun 16 23:00:43 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 23:00:43.778200 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-c62c3cda-3b39-4637-bc04-2879769ee09f tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-925097885", "imageRef": "2b486731-e5ea-4159-b6b1-ed0083e00543", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 23:00:43.911381 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.network.neutron [None req-c62c3cda-3b39-4637-bc04-2879769ee09f tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] validate_networks() for [('3b1257ed-1734-4595-b520-c36ad32e1031', None, None, None, None, None)] {{(pid=117562) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 23:00:44.108602 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-b3e12c3c-684d-4eff-8451-b29e65e46b97 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:00:44.109315 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-b3e12c3c-684d-4eff-8451-b29e65e46b97 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] [instance: d40a3e67-031a-4ad7-bd79-7c7d9a3bece9] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:00:45.171543 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-b3e12c3c-684d-4eff-8451-b29e65e46b97 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a6c4623c5f471b8241257180b64d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2300d78ad8244e3be17c1f388603de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:00:45.218167 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-b3e12c3c-684d-4eff-8451-b29e65e46b97 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] 10.222.0.17 "GET /compute/v2.1/servers/d40a3e67-031a-4ad7-bd79-7c7d9a3bece9" status: 200 len: 1214 microversion: 2.1 time: 1.986415 Jun 16 23:00:45.220528 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 1/3] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:00:43 2022] GET /compute/v2.1/servers/d40a3e67-031a-4ad7-bd79-7c7d9a3bece9 => generated 1214 bytes in 1992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:00:46.239982 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-4446e88c-4d7a-4802-b4af-6d02e2da5e82 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:00:46.241569 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-4446e88c-4d7a-4802-b4af-6d02e2da5e82 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] [instance: d40a3e67-031a-4ad7-bd79-7c7d9a3bece9] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:00:46.265290 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-4446e88c-4d7a-4802-b4af-6d02e2da5e82 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:00:46.265756 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-4446e88c-4d7a-4802-b4af-6d02e2da5e82 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:00:46.266561 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-4446e88c-4d7a-4802-b4af-6d02e2da5e82 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:00:46.275549 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-4446e88c-4d7a-4802-b4af-6d02e2da5e82 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:00:46.595967 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.virt.hardware [None req-c62c3cda-3b39-4637-bc04-2879769ee09f tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Flavor limits 0:0:0 {{(pid=117562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 23:00:46.596495 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.virt.hardware [None req-c62c3cda-3b39-4637-bc04-2879769ee09f tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Image limits 0:0:0 {{(pid=117562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 23:00:46.596858 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.virt.hardware [None req-c62c3cda-3b39-4637-bc04-2879769ee09f tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Flavor pref 0:0:0 {{(pid=117562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 23:00:46.597399 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.virt.hardware [None req-c62c3cda-3b39-4637-bc04-2879769ee09f tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Image pref 0:0:0 {{(pid=117562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 23:00:46.597991 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.virt.hardware [None req-c62c3cda-3b39-4637-bc04-2879769ee09f tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 23:00:46.627899 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-c62c3cda-3b39-4637-bc04-2879769ee09f tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:00:46.629614 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-c62c3cda-3b39-4637-bc04-2879769ee09f tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:00:46.635868 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-c62c3cda-3b39-4637-bc04-2879769ee09f tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:00:46.636643 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-c62c3cda-3b39-4637-bc04-2879769ee09f tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:00:46.713088 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.quota [None req-c62c3cda-3b39-4637-bc04-2879769ee09f tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Getting quotas for project 60447df5461141e883d207e028b74bc7. Resources: {'instances', 'cores', 'ram'} {{(pid=117562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 23:00:46.726493 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.quota [None req-c62c3cda-3b39-4637-bc04-2879769ee09f tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Getting quotas for user 243e592fbf1844d89f55dd5035a684f3 and project 60447df5461141e883d207e028b74bc7. Resources: {'instances', 'cores', 'ram'} {{(pid=117562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 23:00:46.765047 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-c62c3cda-3b39-4637-bc04-2879769ee09f tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Going to run 1 instances... {{(pid=117562) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 23:00:46.770378 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-c62c3cda-3b39-4637-bc04-2879769ee09f tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] [instance: 4ad3ba60-bc63-4d0a-be00-f9b00e66d803] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2b486731-e5ea-4159-b6b1-ed0083e00543',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 23:00:46.899561 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-c62c3cda-3b39-4637-bc04-2879769ee09f tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.273669 Jun 16 23:00:46.906092 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 3/4] 10.222.0.17 () {60 vars in 1146 bytes} [Thu Jun 16 23:00:43 2022] POST /compute/v2.1/servers => generated 383 bytes in 3281 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 16 23:00:46.927807 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-46fe7ff6-dde3-424b-8578-4c00caca2d24 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:00:46.936855 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-46fe7ff6-dde3-424b-8578-4c00caca2d24 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] [instance: 4ad3ba60-bc63-4d0a-be00-f9b00e66d803] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:00:47.044865 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-4446e88c-4d7a-4802-b4af-6d02e2da5e82 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a6c4623c5f471b8241257180b64d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2300d78ad8244e3be17c1f388603de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:00:47.094852 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-4446e88c-4d7a-4802-b4af-6d02e2da5e82 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] 10.222.0.17 "GET /compute/v2.1/servers/d40a3e67-031a-4ad7-bd79-7c7d9a3bece9" status: 200 len: 1210 microversion: 2.1 time: 0.839766 Jun 16 23:00:47.097261 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 2/5] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:00:46 2022] GET /compute/v2.1/servers/d40a3e67-031a-4ad7-bd79-7c7d9a3bece9 => generated 1210 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:00:47.360322 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-80ddcd56-c5ea-489d-ac8a-1b5338d7c99e tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Action: 'create', calling method: .version_select at 0x7f5321cb8310>, body: {"keypair": {"name": "tempest-keypair-1671851097", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMI+bJeOGeGtEiD9/swE9JuuQRH1SqTLCKRB+kxo732bH/QzHikUc6nYsuabnTTAxo4D1RPvYnWqKW99HcGJqtpShuvFL6/lGb4ItiWvjbcnBDjZ7QU0KhYVJuXRVkZrEA=="}} {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 23:00:47.370271 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-46fe7ff6-dde3-424b-8578-4c00caca2d24 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '243e592fbf1844d89f55dd5035a684f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60447df5461141e883d207e028b74bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:00:47.418137 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-46fe7ff6-dde3-424b-8578-4c00caca2d24 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] 10.222.0.17 "GET /compute/v2.1/servers/4ad3ba60-bc63-4d0a-be00-f9b00e66d803" status: 200 len: 1221 microversion: 2.1 time: 0.503464 Jun 16 23:00:47.453473 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 4/6] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:00:46 2022] GET /compute/v2.1/servers/4ad3ba60-bc63-4d0a-be00-f9b00e66d803 => generated 1221 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:00:47.507417 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.quota [None req-80ddcd56-c5ea-489d-ac8a-1b5338d7c99e tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Getting quotas for project 0526c12e8bc947209e24daf5ddfad7be. Resources: {'key_pairs'} {{(pid=117563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 23:00:47.533083 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.quota [None req-80ddcd56-c5ea-489d-ac8a-1b5338d7c99e tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Getting quotas for user 9e3a2d16133b4af8a208682de8a7d111 and project 0526c12e8bc947209e24daf5ddfad7be. Resources: {'key_pairs'} {{(pid=117563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 23:00:47.561581 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-687d0089-fa6b-4a78-ac01-f3a374ebd4e1 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1218767142", "imageRef": "2b486731-e5ea-4159-b6b1-ed0083e00543", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 23:00:47.648231 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-80ddcd56-c5ea-489d-ac8a-1b5338d7c99e tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.430916 Jun 16 23:00:47.649395 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 3/7] 10.222.0.17 () {60 vars in 1158 bytes} [Thu Jun 16 23:00:47 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 23:00:47.699699 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.network.neutron [None req-687d0089-fa6b-4a78-ac01-f3a374ebd4e1 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] validate_networks() for [('3b1257ed-1734-4595-b520-c36ad32e1031', None, None, None, None, None)] {{(pid=117562) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 23:00:48.118444 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-a57d8e73-a8a4-4fc4-9fb8-2a92e89e327b tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:00:48.119414 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-a57d8e73-a8a4-4fc4-9fb8-2a92e89e327b tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] [instance: d40a3e67-031a-4ad7-bd79-7c7d9a3bece9] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:00:48.129735 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-a57d8e73-a8a4-4fc4-9fb8-2a92e89e327b tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:00:48.133605 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-a57d8e73-a8a4-4fc4-9fb8-2a92e89e327b tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:00:48.134634 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-a57d8e73-a8a4-4fc4-9fb8-2a92e89e327b tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:00:48.135248 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-a57d8e73-a8a4-4fc4-9fb8-2a92e89e327b tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:00:48.548491 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-a57d8e73-a8a4-4fc4-9fb8-2a92e89e327b tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a6c4623c5f471b8241257180b64d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2300d78ad8244e3be17c1f388603de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:00:48.580298 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-a57d8e73-a8a4-4fc4-9fb8-2a92e89e327b tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] 10.222.0.17 "GET /compute/v2.1/servers/d40a3e67-031a-4ad7-bd79-7c7d9a3bece9" status: 200 len: 1272 microversion: 2.1 time: 0.470345 Jun 16 23:00:48.584045 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 4/8] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:00:48 2022] GET /compute/v2.1/servers/d40a3e67-031a-4ad7-bd79-7c7d9a3bece9 => generated 1272 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:00:49.615482 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-4d245d4f-773e-42e0-b555-2558913ce260 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:00:49.616953 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-4d245d4f-773e-42e0-b555-2558913ce260 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] [instance: d40a3e67-031a-4ad7-bd79-7c7d9a3bece9] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:00:49.649453 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-4d245d4f-773e-42e0-b555-2558913ce260 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:00:49.651593 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-4d245d4f-773e-42e0-b555-2558913ce260 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:00:49.654081 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-4d245d4f-773e-42e0-b555-2558913ce260 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:00:49.657194 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-4d245d4f-773e-42e0-b555-2558913ce260 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:00:50.920240 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-4d245d4f-773e-42e0-b555-2558913ce260 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a6c4623c5f471b8241257180b64d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2300d78ad8244e3be17c1f388603de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:00:50.934668 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-4d245d4f-773e-42e0-b555-2558913ce260 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] 10.222.0.17 "GET /compute/v2.1/servers/d40a3e67-031a-4ad7-bd79-7c7d9a3bece9" status: 200 len: 1272 microversion: 2.1 time: 1.336591 Jun 16 23:00:50.937098 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 5/9] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:00:49 2022] GET /compute/v2.1/servers/d40a3e67-031a-4ad7-bd79-7c7d9a3bece9 => generated 1272 bytes in 1343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:00:51.952882 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-2eb69b8f-96c4-4b7f-ac36-11b0292f40d5 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:00:51.954701 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-2eb69b8f-96c4-4b7f-ac36-11b0292f40d5 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] [instance: d40a3e67-031a-4ad7-bd79-7c7d9a3bece9] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:00:51.964595 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-2eb69b8f-96c4-4b7f-ac36-11b0292f40d5 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:00:51.965060 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-2eb69b8f-96c4-4b7f-ac36-11b0292f40d5 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:00:51.965921 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-2eb69b8f-96c4-4b7f-ac36-11b0292f40d5 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:00:51.966423 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-2eb69b8f-96c4-4b7f-ac36-11b0292f40d5 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:00:52.321464 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-2eb69b8f-96c4-4b7f-ac36-11b0292f40d5 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a6c4623c5f471b8241257180b64d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2300d78ad8244e3be17c1f388603de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:00:52.325881 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.virt.hardware [None req-687d0089-fa6b-4a78-ac01-f3a374ebd4e1 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Flavor limits 0:0:0 {{(pid=117562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 23:00:52.326385 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.virt.hardware [None req-687d0089-fa6b-4a78-ac01-f3a374ebd4e1 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Image limits 0:0:0 {{(pid=117562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 23:00:52.326768 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.virt.hardware [None req-687d0089-fa6b-4a78-ac01-f3a374ebd4e1 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Flavor pref 0:0:0 {{(pid=117562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 23:00:52.327219 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.virt.hardware [None req-687d0089-fa6b-4a78-ac01-f3a374ebd4e1 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Image pref 0:0:0 {{(pid=117562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 23:00:52.327617 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.virt.hardware [None req-687d0089-fa6b-4a78-ac01-f3a374ebd4e1 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 23:00:52.342969 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-2eb69b8f-96c4-4b7f-ac36-11b0292f40d5 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] 10.222.0.17 "GET /compute/v2.1/servers/d40a3e67-031a-4ad7-bd79-7c7d9a3bece9" status: 200 len: 1272 microversion: 2.1 time: 0.393330 Jun 16 23:00:52.355945 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 6/10] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:00:51 2022] GET /compute/v2.1/servers/d40a3e67-031a-4ad7-bd79-7c7d9a3bece9 => generated 1272 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 23:00:52.356161 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-687d0089-fa6b-4a78-ac01-f3a374ebd4e1 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:00:52.356161 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-687d0089-fa6b-4a78-ac01-f3a374ebd4e1 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:00:52.356161 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-687d0089-fa6b-4a78-ac01-f3a374ebd4e1 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:00:52.356161 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-687d0089-fa6b-4a78-ac01-f3a374ebd4e1 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:00:52.436272 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.quota [None req-687d0089-fa6b-4a78-ac01-f3a374ebd4e1 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Getting quotas for project 60447df5461141e883d207e028b74bc7. Resources: {'instances', 'cores', 'ram'} {{(pid=117562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 23:00:52.448567 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.quota [None req-687d0089-fa6b-4a78-ac01-f3a374ebd4e1 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Getting quotas for user 243e592fbf1844d89f55dd5035a684f3 and project 60447df5461141e883d207e028b74bc7. Resources: {'instances', 'cores', 'ram'} {{(pid=117562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 23:00:52.501786 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-687d0089-fa6b-4a78-ac01-f3a374ebd4e1 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Going to run 1 instances... {{(pid=117562) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 23:00:52.506271 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-687d0089-fa6b-4a78-ac01-f3a374ebd4e1 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] [instance: c2b8ba99-d845-4fca-b9e7-fc77ac91a601] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2b486731-e5ea-4159-b6b1-ed0083e00543',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 23:00:52.656152 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-687d0089-fa6b-4a78-ac01-f3a374ebd4e1 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 5.098312 Jun 16 23:00:52.658448 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 5/11] 10.222.0.17 () {60 vars in 1146 bytes} [Thu Jun 16 23:00:47 2022] POST /compute/v2.1/servers => generated 383 bytes in 5109 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 23:00:52.669022 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-7aa3df4c-0edd-40bd-882b-60b7b02a65c7 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:00:52.678984 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-7aa3df4c-0edd-40bd-882b-60b7b02a65c7 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] [instance: c2b8ba99-d845-4fca-b9e7-fc77ac91a601] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:00:52.692031 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-f495c4ef-71f6-4599-aa64-7849f5ec0ec0 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Action: 'create', calling method: .version_select at 0x7f5321422700>, body: {"keypair": {"name": "tempest-keypair-2141003716", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJZs/1IOr8mU2HVP8dX58COE8tRTJUwpGrz/KvDZ6+2ZcUCdp0QSsL63uxw64jxOcO7XusZesZVvJ13VxvkNHPbNhluauKbMkV4hKeTdoHIegiu1R701zXPbXcJhQTl1Eg=="}} {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 23:00:52.776617 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.quota [None req-f495c4ef-71f6-4599-aa64-7849f5ec0ec0 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Getting quotas for project 6fc0acf708204e1f8f4510cdb1bbf442. Resources: {'key_pairs'} {{(pid=117563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 23:00:52.789769 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.quota [None req-f495c4ef-71f6-4599-aa64-7849f5ec0ec0 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Getting quotas for user a1b1a557a3834b98a3397c41665b5dc6 and project 6fc0acf708204e1f8f4510cdb1bbf442. Resources: {'key_pairs'} {{(pid=117563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 23:00:52.867958 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-f495c4ef-71f6-4599-aa64-7849f5ec0ec0 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.519685 Jun 16 23:00:52.871095 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 7/12] 10.222.0.17 () {62 vars in 1199 bytes} [Thu Jun 16 23:00:52 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 524 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 16 23:00:52.960362 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-7aa3df4c-0edd-40bd-882b-60b7b02a65c7 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '243e592fbf1844d89f55dd5035a684f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60447df5461141e883d207e028b74bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:00:52.967760 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-7aa3df4c-0edd-40bd-882b-60b7b02a65c7 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] 10.222.0.17 "GET /compute/v2.1/servers/c2b8ba99-d845-4fca-b9e7-fc77ac91a601" status: 200 len: 1222 microversion: 2.1 time: 0.302538 Jun 16 23:00:52.968345 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 6/13] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:00:52 2022] GET /compute/v2.1/servers/c2b8ba99-d845-4fca-b9e7-fc77ac91a601 => generated 1222 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 23:00:53.369838 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-2f6a3cbe-24b8-48a8-a39d-9370aea26644 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:00:53.371342 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-2f6a3cbe-24b8-48a8-a39d-9370aea26644 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] [instance: d40a3e67-031a-4ad7-bd79-7c7d9a3bece9] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:00:53.393636 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-2f6a3cbe-24b8-48a8-a39d-9370aea26644 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:00:53.400035 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-2f6a3cbe-24b8-48a8-a39d-9370aea26644 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:00:53.403386 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-2f6a3cbe-24b8-48a8-a39d-9370aea26644 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:00:53.405520 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-2f6a3cbe-24b8-48a8-a39d-9370aea26644 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:00:53.988317 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-8f43c233-496a-4550-ab37-d8a08639b791 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:00:53.990308 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-8f43c233-496a-4550-ab37-d8a08639b791 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] [instance: c2b8ba99-d845-4fca-b9e7-fc77ac91a601] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:00:54.009070 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-8f43c233-496a-4550-ab37-d8a08639b791 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:00:54.010078 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-8f43c233-496a-4550-ab37-d8a08639b791 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:00:54.011323 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-8f43c233-496a-4550-ab37-d8a08639b791 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:00:54.013298 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-8f43c233-496a-4550-ab37-d8a08639b791 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:00:54.836430 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-8f43c233-496a-4550-ab37-d8a08639b791 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '243e592fbf1844d89f55dd5035a684f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60447df5461141e883d207e028b74bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:00:54.871671 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-8f43c233-496a-4550-ab37-d8a08639b791 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] 10.222.0.17 "GET /compute/v2.1/servers/c2b8ba99-d845-4fca-b9e7-fc77ac91a601" status: 200 len: 1226 microversion: 2.1 time: 0.888470 Jun 16 23:00:54.872562 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 7/14] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:00:53 2022] GET /compute/v2.1/servers/c2b8ba99-d845-4fca-b9e7-fc77ac91a601 => generated 1226 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:00:54.936597 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-2f6a3cbe-24b8-48a8-a39d-9370aea26644 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a6c4623c5f471b8241257180b64d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2300d78ad8244e3be17c1f388603de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:00:54.941253 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-3076a867-7473-4924-a8d5-326cfcad4b0f tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1630452491", "imageRef": "2b486731-e5ea-4159-b6b1-ed0083e00543", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9cf34f4a-7249-4d59-a812-ce9cab585661"}], "security_groups": [{"name": "tempest-securitygroup--1563384041"}], "key_name": "tempest-keypair-869930941", "user_data": "}} {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 23:00:54.945534 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-2f6a3cbe-24b8-48a8-a39d-9370aea26644 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] 10.222.0.17 "GET /compute/v2.1/servers/d40a3e67-031a-4ad7-bd79-7c7d9a3bece9" status: 200 len: 1314 microversion: 2.1 time: 1.582450 Jun 16 23:00:54.947018 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 8/15] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:00:53 2022] GET /compute/v2.1/servers/d40a3e67-031a-4ad7-bd79-7c7d9a3bece9 => generated 1314 bytes in 1585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:00:55.476989 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.network.neutron [None req-3076a867-7473-4924-a8d5-326cfcad4b0f tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] validate_networks() for [('9cf34f4a-7249-4d59-a812-ce9cab585661', None, None, None, None, None)] {{(pid=117562) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 23:00:55.889857 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-c2ff4dd2-7014-4df0-9380-494bdb9aea99 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:00:55.890945 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-c2ff4dd2-7014-4df0-9380-494bdb9aea99 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] [instance: c2b8ba99-d845-4fca-b9e7-fc77ac91a601] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:00:55.907973 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-c2ff4dd2-7014-4df0-9380-494bdb9aea99 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:00:55.922033 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-c2ff4dd2-7014-4df0-9380-494bdb9aea99 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:00:55.928516 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-c2ff4dd2-7014-4df0-9380-494bdb9aea99 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:00:55.929127 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-c2ff4dd2-7014-4df0-9380-494bdb9aea99 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:00:56.642872 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-c2ff4dd2-7014-4df0-9380-494bdb9aea99 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '243e592fbf1844d89f55dd5035a684f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60447df5461141e883d207e028b74bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:00:56.658409 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-c2ff4dd2-7014-4df0-9380-494bdb9aea99 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] 10.222.0.17 "GET /compute/v2.1/servers/c2b8ba99-d845-4fca-b9e7-fc77ac91a601" status: 200 len: 1280 microversion: 2.1 time: 0.772106 Jun 16 23:00:56.660380 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 9/16] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:00:55 2022] GET /compute/v2.1/servers/c2b8ba99-d845-4fca-b9e7-fc77ac91a601 => generated 1280 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:00:56.677826 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-773518ab-de01-464c-b9c6-6e038485e075 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:00:56.678569 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-773518ab-de01-464c-b9c6-6e038485e075 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] [instance: d40a3e67-031a-4ad7-bd79-7c7d9a3bece9] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:00:56.695918 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-773518ab-de01-464c-b9c6-6e038485e075 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:00:56.697885 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-773518ab-de01-464c-b9c6-6e038485e075 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:00:56.701820 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-773518ab-de01-464c-b9c6-6e038485e075 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:00:56.704524 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-773518ab-de01-464c-b9c6-6e038485e075 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:00:57.705453 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-773518ab-de01-464c-b9c6-6e038485e075 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a6c4623c5f471b8241257180b64d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2300d78ad8244e3be17c1f388603de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:00:57.730227 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-773518ab-de01-464c-b9c6-6e038485e075 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] 10.222.0.17 "GET /compute/v2.1/servers/d40a3e67-031a-4ad7-bd79-7c7d9a3bece9" status: 200 len: 1314 microversion: 2.1 time: 1.067397 Jun 16 23:00:57.731233 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 10/17] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:00:56 2022] GET /compute/v2.1/servers/d40a3e67-031a-4ad7-bd79-7c7d9a3bece9 => generated 1314 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:00:57.737650 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-6e7d88b6-0672-4d4c-af79-cebde9020f38 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:00:57.739075 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-6e7d88b6-0672-4d4c-af79-cebde9020f38 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] [instance: c2b8ba99-d845-4fca-b9e7-fc77ac91a601] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:00:57.763037 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-6e7d88b6-0672-4d4c-af79-cebde9020f38 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:00:57.763933 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-6e7d88b6-0672-4d4c-af79-cebde9020f38 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:00:57.765173 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-6e7d88b6-0672-4d4c-af79-cebde9020f38 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:00:57.765851 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-6e7d88b6-0672-4d4c-af79-cebde9020f38 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:00:58.263990 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-6e7d88b6-0672-4d4c-af79-cebde9020f38 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '243e592fbf1844d89f55dd5035a684f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60447df5461141e883d207e028b74bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:00:58.283102 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-6e7d88b6-0672-4d4c-af79-cebde9020f38 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] 10.222.0.17 "GET /compute/v2.1/servers/c2b8ba99-d845-4fca-b9e7-fc77ac91a601" status: 200 len: 1280 microversion: 2.1 time: 0.550315 Jun 16 23:00:58.296896 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 11/18] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:00:57 2022] GET /compute/v2.1/servers/c2b8ba99-d845-4fca-b9e7-fc77ac91a601 => generated 1280 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:00:58.754483 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-f2eac35c-912f-4de1-b22e-b760531bf1c9 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:00:58.756204 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-f2eac35c-912f-4de1-b22e-b760531bf1c9 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] [instance: d40a3e67-031a-4ad7-bd79-7c7d9a3bece9] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:00:58.773096 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-f2eac35c-912f-4de1-b22e-b760531bf1c9 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:00:58.775981 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-f2eac35c-912f-4de1-b22e-b760531bf1c9 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:00:58.777133 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-f2eac35c-912f-4de1-b22e-b760531bf1c9 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:00:58.780223 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-f2eac35c-912f-4de1-b22e-b760531bf1c9 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:00:58.908874 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.virt.hardware [None req-3076a867-7473-4924-a8d5-326cfcad4b0f tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Flavor limits 0:0:0 {{(pid=117562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 23:00:58.909702 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.virt.hardware [None req-3076a867-7473-4924-a8d5-326cfcad4b0f tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Image limits 0:0:0 {{(pid=117562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 23:00:58.910493 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.virt.hardware [None req-3076a867-7473-4924-a8d5-326cfcad4b0f tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Flavor pref 0:0:0 {{(pid=117562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 23:00:58.912183 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.virt.hardware [None req-3076a867-7473-4924-a8d5-326cfcad4b0f tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Image pref 0:0:0 {{(pid=117562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 23:00:58.912812 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.virt.hardware [None req-3076a867-7473-4924-a8d5-326cfcad4b0f tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 23:00:58.936613 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-3076a867-7473-4924-a8d5-326cfcad4b0f tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:00:58.937224 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-3076a867-7473-4924-a8d5-326cfcad4b0f tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:00:58.938157 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-3076a867-7473-4924-a8d5-326cfcad4b0f tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:00:58.938734 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-3076a867-7473-4924-a8d5-326cfcad4b0f tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:00:59.001788 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.quota [None req-3076a867-7473-4924-a8d5-326cfcad4b0f tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Getting quotas for project f3b1be8431b0434d8bd6abca293127d5. Resources: {'instances', 'cores', 'ram'} {{(pid=117562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 23:00:59.026646 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.quota [None req-3076a867-7473-4924-a8d5-326cfcad4b0f tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Getting quotas for user 6a993f5d14b64fccad723abecfcadf90 and project f3b1be8431b0434d8bd6abca293127d5. Resources: {'instances', 'cores', 'ram'} {{(pid=117562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 23:00:59.086690 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-3076a867-7473-4924-a8d5-326cfcad4b0f tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Going to run 1 instances... {{(pid=117562) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 23:00:59.089060 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-3076a867-7473-4924-a8d5-326cfcad4b0f tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] [instance: f4c73822-1dfa-4eed-bf02-1123b0402755] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2b486731-e5ea-4159-b6b1-ed0083e00543',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 23:00:59.259818 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-3076a867-7473-4924-a8d5-326cfcad4b0f tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 4.332983 Jun 16 23:00:59.266689 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 8/19] 10.222.0.17 () {60 vars in 1146 bytes} [Thu Jun 16 23:00:54 2022] POST /compute/v2.1/servers => generated 402 bytes in 4340 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 16 23:00:59.292448 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-4a511e9b-08f6-4bb6-9fa6-6efaec5b4404 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:00:59.295094 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-4a511e9b-08f6-4bb6-9fa6-6efaec5b4404 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] [instance: f4c73822-1dfa-4eed-bf02-1123b0402755] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:00:59.708054 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-4a511e9b-08f6-4bb6-9fa6-6efaec5b4404 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a993f5d14b64fccad723abecfcadf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b1be8431b0434d8bd6abca293127d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:00:59.758204 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-4a511e9b-08f6-4bb6-9fa6-6efaec5b4404 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] 10.222.0.17 "GET /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755" status: 200 len: 1237 microversion: 2.1 time: 0.485140 Jun 16 23:00:59.760821 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 9/20] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:00:59 2022] GET /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755 => generated 1237 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:00:59.783765 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-b8656e1b-0dbe-420e-ac00-1038cbb8598e tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:00:59.786918 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-b8656e1b-0dbe-420e-ac00-1038cbb8598e tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] [instance: c2b8ba99-d845-4fca-b9e7-fc77ac91a601] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:00:59.811305 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-b8656e1b-0dbe-420e-ac00-1038cbb8598e tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:00:59.811824 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-b8656e1b-0dbe-420e-ac00-1038cbb8598e tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:00:59.812637 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-b8656e1b-0dbe-420e-ac00-1038cbb8598e tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:00:59.818314 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-b8656e1b-0dbe-420e-ac00-1038cbb8598e tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:00.170167 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-f2eac35c-912f-4de1-b22e-b760531bf1c9 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a6c4623c5f471b8241257180b64d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2300d78ad8244e3be17c1f388603de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:00.198279 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-f2eac35c-912f-4de1-b22e-b760531bf1c9 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] 10.222.0.17 "GET /compute/v2.1/servers/d40a3e67-031a-4ad7-bd79-7c7d9a3bece9" status: 200 len: 1314 microversion: 2.1 time: 1.453239 Jun 16 23:01:00.218466 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 12/21] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:00:58 2022] GET /compute/v2.1/servers/d40a3e67-031a-4ad7-bd79-7c7d9a3bece9 => generated 1314 bytes in 1474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:01:00.517813 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-b8656e1b-0dbe-420e-ac00-1038cbb8598e tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '243e592fbf1844d89f55dd5035a684f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60447df5461141e883d207e028b74bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:00.526714 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-b8656e1b-0dbe-420e-ac00-1038cbb8598e tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] 10.222.0.17 "GET /compute/v2.1/servers/c2b8ba99-d845-4fca-b9e7-fc77ac91a601" status: 200 len: 1322 microversion: 2.1 time: 0.763049 Jun 16 23:01:00.545864 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 10/22] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:00:59 2022] GET /compute/v2.1/servers/c2b8ba99-d845-4fca-b9e7-fc77ac91a601 => generated 1322 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:01:00.783823 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-5d1abdc8-084e-49d8-b0af-8b137af7a146 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:01:00.784637 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-5d1abdc8-084e-49d8-b0af-8b137af7a146 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] [instance: f4c73822-1dfa-4eed-bf02-1123b0402755] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:01:00.798181 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-5d1abdc8-084e-49d8-b0af-8b137af7a146 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:00.798807 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-5d1abdc8-084e-49d8-b0af-8b137af7a146 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:00.804042 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-5d1abdc8-084e-49d8-b0af-8b137af7a146 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:00.807071 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-5d1abdc8-084e-49d8-b0af-8b137af7a146 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:01.223577 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-8f7dded4-f646-402d-8d77-40c9db5db8c1 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:01:01.224699 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-8f7dded4-f646-402d-8d77-40c9db5db8c1 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] [instance: d40a3e67-031a-4ad7-bd79-7c7d9a3bece9] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:01:01.241492 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-8f7dded4-f646-402d-8d77-40c9db5db8c1 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:01.242196 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-8f7dded4-f646-402d-8d77-40c9db5db8c1 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:01.247194 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-8f7dded4-f646-402d-8d77-40c9db5db8c1 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:01.247913 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-8f7dded4-f646-402d-8d77-40c9db5db8c1 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:02.703661 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-5d1abdc8-084e-49d8-b0af-8b137af7a146 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a993f5d14b64fccad723abecfcadf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b1be8431b0434d8bd6abca293127d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:02.712223 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-5d1abdc8-084e-49d8-b0af-8b137af7a146 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] 10.222.0.17 "GET /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755" status: 200 len: 1233 microversion: 2.1 time: 1.938673 Jun 16 23:01:02.735647 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 13/23] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:01:00 2022] GET /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755 => generated 1233 bytes in 1963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:01:02.741092 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-b2bc2aba-67d1-467e-9145-42f6e62d41dd tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:01:02.741727 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-b2bc2aba-67d1-467e-9145-42f6e62d41dd tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] [instance: c2b8ba99-d845-4fca-b9e7-fc77ac91a601] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:01:02.779227 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-b2bc2aba-67d1-467e-9145-42f6e62d41dd tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:02.779890 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-b2bc2aba-67d1-467e-9145-42f6e62d41dd tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:02.781587 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-b2bc2aba-67d1-467e-9145-42f6e62d41dd tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:02.782004 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-b2bc2aba-67d1-467e-9145-42f6e62d41dd tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:02.811676 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG dbcounter [-] [117563] Writing DB stats nova_cell0:SELECT=10 {{(pid=117563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 23:01:02.998799 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-8f7dded4-f646-402d-8d77-40c9db5db8c1 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a6c4623c5f471b8241257180b64d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2300d78ad8244e3be17c1f388603de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:03.022135 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-8f7dded4-f646-402d-8d77-40c9db5db8c1 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] 10.222.0.17 "GET /compute/v2.1/servers/d40a3e67-031a-4ad7-bd79-7c7d9a3bece9" status: 200 len: 1314 microversion: 2.1 time: 1.804327 Jun 16 23:01:03.038392 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 11/24] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:01:01 2022] GET /compute/v2.1/servers/d40a3e67-031a-4ad7-bd79-7c7d9a3bece9 => generated 1314 bytes in 1821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:01:03.676316 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [req-4e5b97ec-44d2-41c0-b4ba-ff112677c88c req-4e559d7f-fb17-4fb9-b85c-42cb77a1eccb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d40a3e67-031a-4ad7-bd79-7c7d9a3bece9", "tag": "d15996c2-23a1-4c1b-834d-20bf7a7f63af"}]} {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 23:01:03.705645 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [req-4e5b97ec-44d2-41c0-b4ba-ff112677c88c req-4e559d7f-fb17-4fb9-b85c-42cb77a1eccb service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:03.708062 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [req-4e5b97ec-44d2-41c0-b4ba-ff112677c88c req-4e559d7f-fb17-4fb9-b85c-42cb77a1eccb service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:03.748192 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-b2bc2aba-67d1-467e-9145-42f6e62d41dd tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '243e592fbf1844d89f55dd5035a684f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60447df5461141e883d207e028b74bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:03.758864 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-b2bc2aba-67d1-467e-9145-42f6e62d41dd tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] 10.222.0.17 "GET /compute/v2.1/servers/c2b8ba99-d845-4fca-b9e7-fc77ac91a601" status: 200 len: 1322 microversion: 2.1 time: 1.021913 Jun 16 23:01:03.762793 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 14/25] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:01:02 2022] GET /compute/v2.1/servers/c2b8ba99-d845-4fca-b9e7-fc77ac91a601 => generated 1322 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:01:03.782513 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-ac6d5a55-d7a8-4904-a277-9ea762acf15f tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:01:03.789893 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-ac6d5a55-d7a8-4904-a277-9ea762acf15f tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] [instance: f4c73822-1dfa-4eed-bf02-1123b0402755] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:01:03.795540 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.compute.server_external_events [req-4e5b97ec-44d2-41c0-b4ba-ff112677c88c req-4e559d7f-fb17-4fb9-b85c-42cb77a1eccb service nova] Creating event network-changed:d15996c2-23a1-4c1b-834d-20bf7a7f63af for instance d40a3e67-031a-4ad7-bd79-7c7d9a3bece9 on hv-cinder-84623 Jun 16 23:01:03.796102 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [req-4e5b97ec-44d2-41c0-b4ba-ff112677c88c req-4e559d7f-fb17-4fb9-b85c-42cb77a1eccb service nova] Acquired lock "compute-rpcapi-router" {{(pid=117562) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 16 23:01:03.797649 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-2e96d786-a121-44c3-b659-549795f7523d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:03.797822 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-2e96d786-a121-44c3-b659-549795f7523d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:03.798508 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-2e96d786-a121-44c3-b659-549795f7523d None None] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:03.807404 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-2e96d786-a121-44c3-b659-549795f7523d None None] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:03.815557 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-ac6d5a55-d7a8-4904-a277-9ea762acf15f tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:03.815955 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-ac6d5a55-d7a8-4904-a277-9ea762acf15f tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:03.820252 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-ac6d5a55-d7a8-4904-a277-9ea762acf15f tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:03.822224 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-ac6d5a55-d7a8-4904-a277-9ea762acf15f tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:03.856779 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.compute.rpcapi [None req-2e96d786-a121-44c3-b659-549795f7523d None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 16 23:01:03.857697 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-2e96d786-a121-44c3-b659-549795f7523d None None] Releasing lock "compute-rpcapi-router" {{(pid=117562) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 16 23:01:03.924224 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-2e96d786-a121-44c3-b659-549795f7523d None None] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.875853 Jun 16 23:01:03.924833 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 12/26] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 23:01:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 23:01:04.047062 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-fb6875b3-12e3-4a5c-a9bd-f110e455de31 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:01:04.052949 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-fb6875b3-12e3-4a5c-a9bd-f110e455de31 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] [instance: d40a3e67-031a-4ad7-bd79-7c7d9a3bece9] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:01:04.062066 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG dbcounter [-] [117562] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=13 {{(pid=117562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 23:01:04.080835 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-fb6875b3-12e3-4a5c-a9bd-f110e455de31 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:04.081332 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-fb6875b3-12e3-4a5c-a9bd-f110e455de31 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:04.082162 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-fb6875b3-12e3-4a5c-a9bd-f110e455de31 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:04.102365 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-fb6875b3-12e3-4a5c-a9bd-f110e455de31 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:04.377291 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-ac6d5a55-d7a8-4904-a277-9ea762acf15f tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a993f5d14b64fccad723abecfcadf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b1be8431b0434d8bd6abca293127d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:04.386068 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-ac6d5a55-d7a8-4904-a277-9ea762acf15f tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] 10.222.0.17 "GET /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755" status: 200 len: 1295 microversion: 2.1 time: 0.620771 Jun 16 23:01:04.402452 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 15/27] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:01:03 2022] GET /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755 => generated 1295 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:01:04.781691 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-aead1652-9450-4d37-9819-032790730800 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:01:04.783908 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-aead1652-9450-4d37-9819-032790730800 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] [instance: c2b8ba99-d845-4fca-b9e7-fc77ac91a601] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:01:04.791511 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-aead1652-9450-4d37-9819-032790730800 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:04.792150 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-aead1652-9450-4d37-9819-032790730800 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:04.793272 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-aead1652-9450-4d37-9819-032790730800 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:04.793859 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-aead1652-9450-4d37-9819-032790730800 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:05.407117 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-aead1652-9450-4d37-9819-032790730800 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '243e592fbf1844d89f55dd5035a684f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60447df5461141e883d207e028b74bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:05.417412 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-fb6875b3-12e3-4a5c-a9bd-f110e455de31 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a6c4623c5f471b8241257180b64d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2300d78ad8244e3be17c1f388603de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:05.433764 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-fb6875b3-12e3-4a5c-a9bd-f110e455de31 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] 10.222.0.17 "GET /compute/v2.1/servers/d40a3e67-031a-4ad7-bd79-7c7d9a3bece9" status: 200 len: 1314 microversion: 2.1 time: 1.391559 Jun 16 23:01:05.437568 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 13/28] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:01:04 2022] GET /compute/v2.1/servers/d40a3e67-031a-4ad7-bd79-7c7d9a3bece9 => generated 1314 bytes in 1396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 23:01:05.438909 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-aead1652-9450-4d37-9819-032790730800 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] 10.222.0.17 "GET /compute/v2.1/servers/c2b8ba99-d845-4fca-b9e7-fc77ac91a601" status: 200 len: 1322 microversion: 2.1 time: 0.660757 Jun 16 23:01:05.439676 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 16/29] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:01:04 2022] GET /compute/v2.1/servers/c2b8ba99-d845-4fca-b9e7-fc77ac91a601 => generated 1322 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 23:01:05.462982 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-3fdbcd1a-f35c-4f88-83cb-16af3454ab99 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1096996615", "imageRef": "2b486731-e5ea-4159-b6b1-ed0083e00543", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f202f4d7-e0e3-4d9b-8b91-98aa75fbf7a3"}], "security_groups": [{"name": "tempest-securitygroup--43648904"}], "key_name": "tempest-keypair-2141003716", "user_data": "}} {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 23:01:05.464287 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-29f3cbda-9d5a-4cd3-b856-61b489fc3478 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1748903269", "imageRef": "2b486731-e5ea-4159-b6b1-ed0083e00543", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "663ca997-5122-4586-973b-ea2e3ed98672"}], "security_groups": [{"name": "tempest-securitygroup--100088424"}], "key_name": "tempest-keypair-1671851097", "user_data": "}} {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 23:01:05.947524 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.network.neutron [None req-29f3cbda-9d5a-4cd3-b856-61b489fc3478 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] validate_networks() for [('663ca997-5122-4586-973b-ea2e3ed98672', None, None, None, None, None)] {{(pid=117562) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 23:01:05.970299 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.network.neutron [None req-3fdbcd1a-f35c-4f88-83cb-16af3454ab99 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] validate_networks() for [('f202f4d7-e0e3-4d9b-8b91-98aa75fbf7a3', None, None, None, None, None)] {{(pid=117563) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 23:01:06.596004 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.virt.hardware [None req-29f3cbda-9d5a-4cd3-b856-61b489fc3478 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Flavor limits 0:0:0 {{(pid=117562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 23:01:06.596514 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.virt.hardware [None req-29f3cbda-9d5a-4cd3-b856-61b489fc3478 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Image limits 0:0:0 {{(pid=117562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 23:01:06.597076 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.virt.hardware [None req-29f3cbda-9d5a-4cd3-b856-61b489fc3478 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Flavor pref 0:0:0 {{(pid=117562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 23:01:06.597611 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.virt.hardware [None req-29f3cbda-9d5a-4cd3-b856-61b489fc3478 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Image pref 0:0:0 {{(pid=117562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 23:01:06.598250 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.virt.hardware [None req-29f3cbda-9d5a-4cd3-b856-61b489fc3478 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 23:01:06.621617 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-29f3cbda-9d5a-4cd3-b856-61b489fc3478 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:06.623205 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-29f3cbda-9d5a-4cd3-b856-61b489fc3478 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:06.625374 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-29f3cbda-9d5a-4cd3-b856-61b489fc3478 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:06.626784 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-29f3cbda-9d5a-4cd3-b856-61b489fc3478 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:06.662737 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.quota [None req-29f3cbda-9d5a-4cd3-b856-61b489fc3478 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Getting quotas for project 0526c12e8bc947209e24daf5ddfad7be. Resources: {'instances', 'cores', 'ram'} {{(pid=117562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 23:01:06.673875 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.quota [None req-29f3cbda-9d5a-4cd3-b856-61b489fc3478 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Getting quotas for user 9e3a2d16133b4af8a208682de8a7d111 and project 0526c12e8bc947209e24daf5ddfad7be. Resources: {'instances', 'cores', 'ram'} {{(pid=117562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 23:01:06.693658 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-29f3cbda-9d5a-4cd3-b856-61b489fc3478 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Going to run 1 instances... {{(pid=117562) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 23:01:06.697956 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-29f3cbda-9d5a-4cd3-b856-61b489fc3478 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] [instance: 5cfd118b-cc42-4dbe-93f1-784454892318] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2b486731-e5ea-4159-b6b1-ed0083e00543',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 23:01:06.811293 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-29f3cbda-9d5a-4cd3-b856-61b489fc3478 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.368975 Jun 16 23:01:06.812906 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 14/30] 10.222.0.17 () {60 vars in 1146 bytes} [Thu Jun 16 23:01:05 2022] POST /compute/v2.1/servers => generated 401 bytes in 1375 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 23:01:06.826110 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-fdd33155-1fc0-422c-ada5-a86626a246fd tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:01:06.827924 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-fdd33155-1fc0-422c-ada5-a86626a246fd tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] [instance: f4c73822-1dfa-4eed-bf02-1123b0402755] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:01:06.839147 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-fdd33155-1fc0-422c-ada5-a86626a246fd tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:06.840132 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-fdd33155-1fc0-422c-ada5-a86626a246fd tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:06.841252 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-fdd33155-1fc0-422c-ada5-a86626a246fd tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:06.842129 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-fdd33155-1fc0-422c-ada5-a86626a246fd tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:06.985568 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-fdd33155-1fc0-422c-ada5-a86626a246fd tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a993f5d14b64fccad723abecfcadf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b1be8431b0434d8bd6abca293127d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:06.997080 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-fdd33155-1fc0-422c-ada5-a86626a246fd tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] 10.222.0.17 "GET /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755" status: 200 len: 1295 microversion: 2.1 time: 0.182589 Jun 16 23:01:07.000662 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 15/31] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:01:06 2022] GET /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755 => generated 1295 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:01:07.089319 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [req-b5821e75-b127-4d25-8f76-f03a20e14481 req-51f8edb3-2cec-4184-bc56-dfce0e86910f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2b8ba99-d845-4fca-b9e7-fc77ac91a601", "tag": "020e6819-d071-41f2-9573-ea592ee5004c"}]} {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 23:01:07.106842 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [req-b5821e75-b127-4d25-8f76-f03a20e14481 req-51f8edb3-2cec-4184-bc56-dfce0e86910f service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:07.107475 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [req-b5821e75-b127-4d25-8f76-f03a20e14481 req-51f8edb3-2cec-4184-bc56-dfce0e86910f service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:07.143621 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.virt.hardware [None req-3fdbcd1a-f35c-4f88-83cb-16af3454ab99 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Flavor limits 0:0:0 {{(pid=117563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 23:01:07.144135 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.virt.hardware [None req-3fdbcd1a-f35c-4f88-83cb-16af3454ab99 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Image limits 0:0:0 {{(pid=117563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 23:01:07.144532 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.virt.hardware [None req-3fdbcd1a-f35c-4f88-83cb-16af3454ab99 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Flavor pref 0:0:0 {{(pid=117563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 23:01:07.144940 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.virt.hardware [None req-3fdbcd1a-f35c-4f88-83cb-16af3454ab99 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Image pref 0:0:0 {{(pid=117563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 23:01:07.145524 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.virt.hardware [None req-3fdbcd1a-f35c-4f88-83cb-16af3454ab99 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 23:01:07.162710 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-3fdbcd1a-f35c-4f88-83cb-16af3454ab99 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:07.170021 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.compute.server_external_events [req-b5821e75-b127-4d25-8f76-f03a20e14481 req-51f8edb3-2cec-4184-bc56-dfce0e86910f service nova] Creating event network-changed:020e6819-d071-41f2-9573-ea592ee5004c for instance c2b8ba99-d845-4fca-b9e7-fc77ac91a601 on hv-cinder-84623 Jun 16 23:01:07.174921 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-3fdbcd1a-f35c-4f88-83cb-16af3454ab99 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:07.176090 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-3fdbcd1a-f35c-4f88-83cb-16af3454ab99 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:07.176704 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-3fdbcd1a-f35c-4f88-83cb-16af3454ab99 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:07.185833 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [req-b5821e75-b127-4d25-8f76-f03a20e14481 req-51f8edb3-2cec-4184-bc56-dfce0e86910f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.183846 Jun 16 23:01:07.186563 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 16/32] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 23:01:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 23:01:07.196192 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-131ebc64-6fff-4061-acd3-527c403697a5 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:01:07.197041 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-131ebc64-6fff-4061-acd3-527c403697a5 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] [instance: d40a3e67-031a-4ad7-bd79-7c7d9a3bece9] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:01:07.207054 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-131ebc64-6fff-4061-acd3-527c403697a5 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:07.207787 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-131ebc64-6fff-4061-acd3-527c403697a5 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:07.208867 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-131ebc64-6fff-4061-acd3-527c403697a5 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:07.209563 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-131ebc64-6fff-4061-acd3-527c403697a5 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:07.233390 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.quota [None req-3fdbcd1a-f35c-4f88-83cb-16af3454ab99 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Getting quotas for project 6fc0acf708204e1f8f4510cdb1bbf442. Resources: {'instances', 'cores', 'ram'} {{(pid=117563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 23:01:07.238456 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.quota [None req-3fdbcd1a-f35c-4f88-83cb-16af3454ab99 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Getting quotas for user a1b1a557a3834b98a3397c41665b5dc6 and project 6fc0acf708204e1f8f4510cdb1bbf442. Resources: {'instances', 'cores', 'ram'} {{(pid=117563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 23:01:07.280921 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-3fdbcd1a-f35c-4f88-83cb-16af3454ab99 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Going to run 1 instances... {{(pid=117563) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 23:01:07.289530 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-3fdbcd1a-f35c-4f88-83cb-16af3454ab99 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 46f43909-d681-4938-8253-5080b626e169] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2b486731-e5ea-4159-b6b1-ed0083e00543',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117563) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 23:01:07.430417 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-131ebc64-6fff-4061-acd3-527c403697a5 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a6c4623c5f471b8241257180b64d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2300d78ad8244e3be17c1f388603de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:07.439408 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-131ebc64-6fff-4061-acd3-527c403697a5 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] 10.222.0.17 "GET /compute/v2.1/servers/d40a3e67-031a-4ad7-bd79-7c7d9a3bece9" status: 200 len: 1314 microversion: 2.1 time: 0.251348 Jun 16 23:01:07.443851 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 17/33] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:01:07 2022] GET /compute/v2.1/servers/d40a3e67-031a-4ad7-bd79-7c7d9a3bece9 => generated 1314 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:01:07.458877 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-aa4b5466-b7de-4b61-b061-f87f78db535c tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:01:07.460035 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-aa4b5466-b7de-4b61-b061-f87f78db535c tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] [instance: c2b8ba99-d845-4fca-b9e7-fc77ac91a601] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:01:07.476135 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-3fdbcd1a-f35c-4f88-83cb-16af3454ab99 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.20 time: 2.034111 Jun 16 23:01:07.481699 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 17/34] 10.222.0.17 () {62 vars in 1187 bytes} [Thu Jun 16 23:01:05 2022] POST /compute/v2.1/servers => generated 400 bytes in 2040 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 16 23:01:07.488219 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [req-374091d8-7dc5-4cf3-bae2-a3fbb2dc0372 req-90867241-22ad-4589-b068-dbd35ef26124 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ad3ba60-bc63-4d0a-be00-f9b00e66d803", "tag": "27dc1467-d62f-4447-a2e6-d4697ce9cdfa"}]} {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 23:01:07.493653 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-aa4b5466-b7de-4b61-b061-f87f78db535c tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:07.494237 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-aa4b5466-b7de-4b61-b061-f87f78db535c tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:07.495159 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-aa4b5466-b7de-4b61-b061-f87f78db535c tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:07.495927 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-aa4b5466-b7de-4b61-b061-f87f78db535c tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:07.503743 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-374091d8-7dc5-4cf3-bae2-a3fbb2dc0372 req-90867241-22ad-4589-b068-dbd35ef26124 service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:07.504343 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-374091d8-7dc5-4cf3-bae2-a3fbb2dc0372 req-90867241-22ad-4589-b068-dbd35ef26124 service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:07.536348 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.compute.server_external_events [req-374091d8-7dc5-4cf3-bae2-a3fbb2dc0372 req-90867241-22ad-4589-b068-dbd35ef26124 service nova] Creating event network-changed:27dc1467-d62f-4447-a2e6-d4697ce9cdfa for instance 4ad3ba60-bc63-4d0a-be00-f9b00e66d803 on hv-cinder-84623 Jun 16 23:01:07.536895 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-374091d8-7dc5-4cf3-bae2-a3fbb2dc0372 req-90867241-22ad-4589-b068-dbd35ef26124 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117563) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 16 23:01:07.538075 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-e6d8dcd8-1bd8-4b2b-87da-39a381b7f87f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:07.538625 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-e6d8dcd8-1bd8-4b2b-87da-39a381b7f87f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:07.547228 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-e6d8dcd8-1bd8-4b2b-87da-39a381b7f87f None None] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:07.547992 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-e6d8dcd8-1bd8-4b2b-87da-39a381b7f87f None None] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:07.565717 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.compute.rpcapi [None req-e6d8dcd8-1bd8-4b2b-87da-39a381b7f87f None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 16 23:01:07.566990 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-e6d8dcd8-1bd8-4b2b-87da-39a381b7f87f None None] Releasing lock "compute-rpcapi-router" {{(pid=117563) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 16 23:01:07.612223 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-e6d8dcd8-1bd8-4b2b-87da-39a381b7f87f None None] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128306 Jun 16 23:01:07.619097 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 18/35] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 23:01:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 23:01:07.627523 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-249b6e43-83af-4729-9443-844759b1895e tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:01:07.629127 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-249b6e43-83af-4729-9443-844759b1895e tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] [instance: 5cfd118b-cc42-4dbe-93f1-784454892318] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:01:07.641325 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-249b6e43-83af-4729-9443-844759b1895e tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:07.642080 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-249b6e43-83af-4729-9443-844759b1895e tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:07.643540 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-249b6e43-83af-4729-9443-844759b1895e tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:07.644539 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-249b6e43-83af-4729-9443-844759b1895e tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:07.709882 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-aa4b5466-b7de-4b61-b061-f87f78db535c tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '243e592fbf1844d89f55dd5035a684f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60447df5461141e883d207e028b74bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:07.719294 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-aa4b5466-b7de-4b61-b061-f87f78db535c tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] 10.222.0.17 "GET /compute/v2.1/servers/c2b8ba99-d845-4fca-b9e7-fc77ac91a601" status: 200 len: 1322 microversion: 2.1 time: 0.274347 Jun 16 23:01:07.720364 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 18/36] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:01:07 2022] GET /compute/v2.1/servers/c2b8ba99-d845-4fca-b9e7-fc77ac91a601 => generated 1322 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:01:07.726473 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-6530978a-14f7-47fa-9ae0-381d19bbabd1 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:01:07.727214 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-6530978a-14f7-47fa-9ae0-381d19bbabd1 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 46f43909-d681-4938-8253-5080b626e169] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:01:07.737854 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-249b6e43-83af-4729-9443-844759b1895e tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3a2d16133b4af8a208682de8a7d111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0526c12e8bc947209e24daf5ddfad7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:07.745505 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-249b6e43-83af-4729-9443-844759b1895e tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] 10.222.0.17 "GET /compute/v2.1/servers/5cfd118b-cc42-4dbe-93f1-784454892318" status: 200 len: 1246 microversion: 2.1 time: 0.124831 Jun 16 23:01:07.746360 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 19/37] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:01:07 2022] GET /compute/v2.1/servers/5cfd118b-cc42-4dbe-93f1-784454892318 => generated 1246 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:01:07.785772 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-6530978a-14f7-47fa-9ae0-381d19bbabd1 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:07.793620 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-6530978a-14f7-47fa-9ae0-381d19bbabd1 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:07.795471 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-6530978a-14f7-47fa-9ae0-381d19bbabd1 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:07.796780 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-6530978a-14f7-47fa-9ae0-381d19bbabd1 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169" status: 200 len: 1282 microversion: 2.20 time: 0.074990 Jun 16 23:01:07.797455 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 19/38] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 23:01:07 2022] GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169 => generated 1282 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 23:01:08.014700 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-f40867a3-7709-427e-beab-83b2b34dc423 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:01:08.015632 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-f40867a3-7709-427e-beab-83b2b34dc423 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] [instance: f4c73822-1dfa-4eed-bf02-1123b0402755] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:01:08.022227 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-f40867a3-7709-427e-beab-83b2b34dc423 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:08.022713 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-f40867a3-7709-427e-beab-83b2b34dc423 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:08.023532 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-f40867a3-7709-427e-beab-83b2b34dc423 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:08.023975 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-f40867a3-7709-427e-beab-83b2b34dc423 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:08.315243 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-f40867a3-7709-427e-beab-83b2b34dc423 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a993f5d14b64fccad723abecfcadf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b1be8431b0434d8bd6abca293127d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:08.322818 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-f40867a3-7709-427e-beab-83b2b34dc423 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] 10.222.0.17 "GET /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755" status: 200 len: 1295 microversion: 2.1 time: 0.312100 Jun 16 23:01:08.323392 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 20/39] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:01:08 2022] GET /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755 => generated 1295 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:01:08.458287 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-dc27efac-5277-41bc-9078-6f7001a19d8a tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:01:08.459085 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-dc27efac-5277-41bc-9078-6f7001a19d8a tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] [instance: d40a3e67-031a-4ad7-bd79-7c7d9a3bece9] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:01:08.466605 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-dc27efac-5277-41bc-9078-6f7001a19d8a tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:08.467320 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-dc27efac-5277-41bc-9078-6f7001a19d8a tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:08.468240 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-dc27efac-5277-41bc-9078-6f7001a19d8a tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:08.468906 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-dc27efac-5277-41bc-9078-6f7001a19d8a tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:08.623023 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-dc27efac-5277-41bc-9078-6f7001a19d8a tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a6c4623c5f471b8241257180b64d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2300d78ad8244e3be17c1f388603de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:08.631770 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-dc27efac-5277-41bc-9078-6f7001a19d8a tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] 10.222.0.17 "GET /compute/v2.1/servers/d40a3e67-031a-4ad7-bd79-7c7d9a3bece9" status: 200 len: 1314 microversion: 2.1 time: 0.178302 Jun 16 23:01:08.639088 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 20/40] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:01:08 2022] GET /compute/v2.1/servers/d40a3e67-031a-4ad7-bd79-7c7d9a3bece9 => generated 1314 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:01:08.739045 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-bb8ed423-74ff-475d-9749-85522dfe4fc8 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:01:08.739938 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-bb8ed423-74ff-475d-9749-85522dfe4fc8 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] [instance: c2b8ba99-d845-4fca-b9e7-fc77ac91a601] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:01:08.746624 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-bb8ed423-74ff-475d-9749-85522dfe4fc8 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:08.747095 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-bb8ed423-74ff-475d-9749-85522dfe4fc8 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:08.747879 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-bb8ed423-74ff-475d-9749-85522dfe4fc8 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:08.748341 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-bb8ed423-74ff-475d-9749-85522dfe4fc8 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:08.763386 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-8e70206f-5b66-43b6-a2cf-091d2f58d727 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:01:08.766670 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-8e70206f-5b66-43b6-a2cf-091d2f58d727 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] [instance: 5cfd118b-cc42-4dbe-93f1-784454892318] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:01:08.768294 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG dbcounter [-] [117563] Writing DB stats nova_cell1:SELECT=100 {{(pid=117563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 23:01:08.775633 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-8e70206f-5b66-43b6-a2cf-091d2f58d727 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:08.776525 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-8e70206f-5b66-43b6-a2cf-091d2f58d727 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:08.778281 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-8e70206f-5b66-43b6-a2cf-091d2f58d727 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:08.779403 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-8e70206f-5b66-43b6-a2cf-091d2f58d727 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:08.875052 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-8e70206f-5b66-43b6-a2cf-091d2f58d727 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3a2d16133b4af8a208682de8a7d111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0526c12e8bc947209e24daf5ddfad7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:08.882383 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-8e70206f-5b66-43b6-a2cf-091d2f58d727 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] 10.222.0.17 "GET /compute/v2.1/servers/5cfd118b-cc42-4dbe-93f1-784454892318" status: 200 len: 1238 microversion: 2.1 time: 0.122807 Jun 16 23:01:08.882979 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 21/41] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:01:08 2022] GET /compute/v2.1/servers/5cfd118b-cc42-4dbe-93f1-784454892318 => generated 1238 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:01:08.897265 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-e5e2bc75-c3f4-4eb5-9449-860e74c8bf21 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:01:08.898064 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-e5e2bc75-c3f4-4eb5-9449-860e74c8bf21 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 46f43909-d681-4938-8253-5080b626e169] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:01:08.915983 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-e5e2bc75-c3f4-4eb5-9449-860e74c8bf21 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:08.916566 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-e5e2bc75-c3f4-4eb5-9449-860e74c8bf21 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:08.917838 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-e5e2bc75-c3f4-4eb5-9449-860e74c8bf21 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:08.918672 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-e5e2bc75-c3f4-4eb5-9449-860e74c8bf21 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:08.924472 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-bb8ed423-74ff-475d-9749-85522dfe4fc8 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '243e592fbf1844d89f55dd5035a684f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60447df5461141e883d207e028b74bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:08.934846 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-bb8ed423-74ff-475d-9749-85522dfe4fc8 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] 10.222.0.17 "GET /compute/v2.1/servers/c2b8ba99-d845-4fca-b9e7-fc77ac91a601" status: 200 len: 1322 microversion: 2.1 time: 0.200323 Jun 16 23:01:08.935519 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 21/42] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:01:08 2022] GET /compute/v2.1/servers/c2b8ba99-d845-4fca-b9e7-fc77ac91a601 => generated 1322 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:01:08.992468 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-e5e2bc75-c3f4-4eb5-9449-860e74c8bf21 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:09.004590 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-e5e2bc75-c3f4-4eb5-9449-860e74c8bf21 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:09.006424 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-e5e2bc75-c3f4-4eb5-9449-860e74c8bf21 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:09.007739 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-e5e2bc75-c3f4-4eb5-9449-860e74c8bf21 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169" status: 200 len: 1278 microversion: 2.20 time: 0.123704 Jun 16 23:01:09.019419 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 22/43] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 23:01:08 2022] GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169 => generated 1278 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 23:01:09.340197 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-74ae5776-3f11-4eb1-8f32-5640eb78f80c tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:01:09.340814 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-74ae5776-3f11-4eb1-8f32-5640eb78f80c tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] [instance: f4c73822-1dfa-4eed-bf02-1123b0402755] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:01:09.346828 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-74ae5776-3f11-4eb1-8f32-5640eb78f80c tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:09.347323 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-74ae5776-3f11-4eb1-8f32-5640eb78f80c tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:09.348108 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-74ae5776-3f11-4eb1-8f32-5640eb78f80c tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:09.348553 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-74ae5776-3f11-4eb1-8f32-5640eb78f80c tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:09.479398 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-74ae5776-3f11-4eb1-8f32-5640eb78f80c tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a993f5d14b64fccad723abecfcadf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b1be8431b0434d8bd6abca293127d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:09.486951 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-74ae5776-3f11-4eb1-8f32-5640eb78f80c tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] 10.222.0.17 "GET /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755" status: 200 len: 1363 microversion: 2.1 time: 0.150566 Jun 16 23:01:09.487543 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 22/44] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:01:09 2022] GET /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755 => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:01:09.648571 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-68dcf08f-32b1-49f1-b1a5-aa086257a2f7 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:01:09.649214 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-68dcf08f-32b1-49f1-b1a5-aa086257a2f7 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] [instance: d40a3e67-031a-4ad7-bd79-7c7d9a3bece9] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:01:09.655255 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-68dcf08f-32b1-49f1-b1a5-aa086257a2f7 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:09.655708 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-68dcf08f-32b1-49f1-b1a5-aa086257a2f7 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:09.656470 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-68dcf08f-32b1-49f1-b1a5-aa086257a2f7 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:09.656932 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-68dcf08f-32b1-49f1-b1a5-aa086257a2f7 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:09.784164 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-68dcf08f-32b1-49f1-b1a5-aa086257a2f7 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a6c4623c5f471b8241257180b64d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2300d78ad8244e3be17c1f388603de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:09.787053 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG dbcounter [-] [117562] Writing DB stats nova_cell1:SELECT=81 {{(pid=117562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 23:01:09.793506 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-68dcf08f-32b1-49f1-b1a5-aa086257a2f7 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] 10.222.0.17 "GET /compute/v2.1/servers/d40a3e67-031a-4ad7-bd79-7c7d9a3bece9" status: 200 len: 1314 microversion: 2.1 time: 0.149289 Jun 16 23:01:09.794082 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 23/45] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:01:09 2022] GET /compute/v2.1/servers/d40a3e67-031a-4ad7-bd79-7c7d9a3bece9 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:01:09.899575 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-11923fe4-95cf-4b55-bbe7-356129cec634 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:01:09.900209 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-11923fe4-95cf-4b55-bbe7-356129cec634 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] [instance: 5cfd118b-cc42-4dbe-93f1-784454892318] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:01:09.906045 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-11923fe4-95cf-4b55-bbe7-356129cec634 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:09.906493 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-11923fe4-95cf-4b55-bbe7-356129cec634 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:09.907284 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-11923fe4-95cf-4b55-bbe7-356129cec634 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:09.907718 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-11923fe4-95cf-4b55-bbe7-356129cec634 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:09.950784 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-e86ce109-7744-481c-a89d-36c84eb6ef50 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:01:09.951400 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-e86ce109-7744-481c-a89d-36c84eb6ef50 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] [instance: c2b8ba99-d845-4fca-b9e7-fc77ac91a601] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:01:09.958002 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-e86ce109-7744-481c-a89d-36c84eb6ef50 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:09.958451 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-e86ce109-7744-481c-a89d-36c84eb6ef50 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:09.959249 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-e86ce109-7744-481c-a89d-36c84eb6ef50 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:09.959690 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-e86ce109-7744-481c-a89d-36c84eb6ef50 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:09.969086 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-11923fe4-95cf-4b55-bbe7-356129cec634 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3a2d16133b4af8a208682de8a7d111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0526c12e8bc947209e24daf5ddfad7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:09.976978 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-11923fe4-95cf-4b55-bbe7-356129cec634 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] 10.222.0.17 "GET /compute/v2.1/servers/5cfd118b-cc42-4dbe-93f1-784454892318" status: 200 len: 1238 microversion: 2.1 time: 0.081173 Jun 16 23:01:09.977542 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 23/46] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:01:09 2022] GET /compute/v2.1/servers/5cfd118b-cc42-4dbe-93f1-784454892318 => generated 1238 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 23:01:10.025495 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-87484119-1447-4385-bd34-a3903c84b51a tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:01:10.026108 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-87484119-1447-4385-bd34-a3903c84b51a tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 46f43909-d681-4938-8253-5080b626e169] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:01:10.032224 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-87484119-1447-4385-bd34-a3903c84b51a tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:10.032683 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-87484119-1447-4385-bd34-a3903c84b51a tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:10.033461 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-87484119-1447-4385-bd34-a3903c84b51a tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:10.033935 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-87484119-1447-4385-bd34-a3903c84b51a tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:10.103678 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-87484119-1447-4385-bd34-a3903c84b51a tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:10.111768 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-87484119-1447-4385-bd34-a3903c84b51a tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:10.113315 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-87484119-1447-4385-bd34-a3903c84b51a tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:10.114415 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-87484119-1447-4385-bd34-a3903c84b51a tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169" status: 200 len: 1278 microversion: 2.20 time: 0.092740 Jun 16 23:01:10.115085 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 24/47] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 23:01:10 2022] GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169 => generated 1278 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 23:01:10.119666 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-e86ce109-7744-481c-a89d-36c84eb6ef50 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '243e592fbf1844d89f55dd5035a684f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60447df5461141e883d207e028b74bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:10.127019 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-e86ce109-7744-481c-a89d-36c84eb6ef50 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] 10.222.0.17 "GET /compute/v2.1/servers/c2b8ba99-d845-4fca-b9e7-fc77ac91a601" status: 200 len: 1322 microversion: 2.1 time: 0.180362 Jun 16 23:01:10.127593 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 24/48] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:01:09 2022] GET /compute/v2.1/servers/c2b8ba99-d845-4fca-b9e7-fc77ac91a601 => generated 1322 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 23:01:10.503700 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-2879e842-0399-4f95-8423-d4e99cf0aad6 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:01:10.504323 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-2879e842-0399-4f95-8423-d4e99cf0aad6 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] [instance: f4c73822-1dfa-4eed-bf02-1123b0402755] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:01:10.510299 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-2879e842-0399-4f95-8423-d4e99cf0aad6 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:10.510790 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-2879e842-0399-4f95-8423-d4e99cf0aad6 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:10.511564 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-2879e842-0399-4f95-8423-d4e99cf0aad6 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:10.512007 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-2879e842-0399-4f95-8423-d4e99cf0aad6 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:10.642435 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-2879e842-0399-4f95-8423-d4e99cf0aad6 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a993f5d14b64fccad723abecfcadf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b1be8431b0434d8bd6abca293127d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:10.649831 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-2879e842-0399-4f95-8423-d4e99cf0aad6 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] 10.222.0.17 "GET /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755" status: 200 len: 1363 microversion: 2.1 time: 0.150476 Jun 16 23:01:10.650429 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 25/49] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:01:10 2022] GET /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755 => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:01:10.812353 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-49e8de87-17a5-4c6b-acdb-18075ff46e30 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:01:10.813677 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-49e8de87-17a5-4c6b-acdb-18075ff46e30 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] [instance: d40a3e67-031a-4ad7-bd79-7c7d9a3bece9] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:01:10.822413 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-49e8de87-17a5-4c6b-acdb-18075ff46e30 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:10.823136 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-49e8de87-17a5-4c6b-acdb-18075ff46e30 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:10.824301 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-49e8de87-17a5-4c6b-acdb-18075ff46e30 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:10.824976 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-49e8de87-17a5-4c6b-acdb-18075ff46e30 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:10.996995 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-d1827897-8d67-4621-8e84-b99411aef453 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:01:10.997915 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-d1827897-8d67-4621-8e84-b99411aef453 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] [instance: 5cfd118b-cc42-4dbe-93f1-784454892318] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:01:11.004667 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-d1827897-8d67-4621-8e84-b99411aef453 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:11.005480 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-d1827897-8d67-4621-8e84-b99411aef453 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:11.006534 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-d1827897-8d67-4621-8e84-b99411aef453 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:11.007091 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-d1827897-8d67-4621-8e84-b99411aef453 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:11.026731 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-49e8de87-17a5-4c6b-acdb-18075ff46e30 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a6c4623c5f471b8241257180b64d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2300d78ad8244e3be17c1f388603de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:11.036326 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-49e8de87-17a5-4c6b-acdb-18075ff46e30 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] 10.222.0.17 "GET /compute/v2.1/servers/d40a3e67-031a-4ad7-bd79-7c7d9a3bece9" status: 200 len: 1314 microversion: 2.1 time: 0.228954 Jun 16 23:01:11.037450 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 25/50] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:01:10 2022] GET /compute/v2.1/servers/d40a3e67-031a-4ad7-bd79-7c7d9a3bece9 => generated 1314 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:01:11.077555 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-d1827897-8d67-4621-8e84-b99411aef453 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3a2d16133b4af8a208682de8a7d111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0526c12e8bc947209e24daf5ddfad7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:11.085710 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-d1827897-8d67-4621-8e84-b99411aef453 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] 10.222.0.17 "GET /compute/v2.1/servers/5cfd118b-cc42-4dbe-93f1-784454892318" status: 200 len: 1294 microversion: 2.1 time: 0.092943 Jun 16 23:01:11.086275 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 26/51] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:01:10 2022] GET /compute/v2.1/servers/5cfd118b-cc42-4dbe-93f1-784454892318 => generated 1294 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:01:11.134450 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-370cb3e3-ff57-4c63-bab9-b4b643d16357 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:01:11.135162 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-370cb3e3-ff57-4c63-bab9-b4b643d16357 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 46f43909-d681-4938-8253-5080b626e169] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:01:11.148147 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-7bb80f5a-5b6b-4ea6-94df-9b84e71bc680 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:01:11.148147 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-7bb80f5a-5b6b-4ea6-94df-9b84e71bc680 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] [instance: c2b8ba99-d845-4fca-b9e7-fc77ac91a601] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:01:11.148629 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-370cb3e3-ff57-4c63-bab9-b4b643d16357 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:11.149293 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-370cb3e3-ff57-4c63-bab9-b4b643d16357 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:11.150417 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-370cb3e3-ff57-4c63-bab9-b4b643d16357 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:11.151192 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-370cb3e3-ff57-4c63-bab9-b4b643d16357 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:11.152580 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-7bb80f5a-5b6b-4ea6-94df-9b84e71bc680 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:11.153104 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-7bb80f5a-5b6b-4ea6-94df-9b84e71bc680 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:11.154001 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-7bb80f5a-5b6b-4ea6-94df-9b84e71bc680 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:11.154680 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-7bb80f5a-5b6b-4ea6-94df-9b84e71bc680 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:11.239388 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-370cb3e3-ff57-4c63-bab9-b4b643d16357 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:11.260670 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-370cb3e3-ff57-4c63-bab9-b4b643d16357 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:11.263611 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-370cb3e3-ff57-4c63-bab9-b4b643d16357 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:11.265033 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-370cb3e3-ff57-4c63-bab9-b4b643d16357 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169" status: 200 len: 1334 microversion: 2.20 time: 0.135096 Jun 16 23:01:11.266683 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 26/52] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 23:01:11 2022] GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169 => generated 1334 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 23:01:11.342205 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-7bb80f5a-5b6b-4ea6-94df-9b84e71bc680 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '243e592fbf1844d89f55dd5035a684f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60447df5461141e883d207e028b74bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:11.350813 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-7bb80f5a-5b6b-4ea6-94df-9b84e71bc680 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] 10.222.0.17 "GET /compute/v2.1/servers/c2b8ba99-d845-4fca-b9e7-fc77ac91a601" status: 200 len: 1322 microversion: 2.1 time: 0.211022 Jun 16 23:01:11.359944 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 27/53] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:01:11 2022] GET /compute/v2.1/servers/c2b8ba99-d845-4fca-b9e7-fc77ac91a601 => generated 1322 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:01:11.597945 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [req-24e28bf1-2e00-4630-aa9a-5d626f9016f5 req-0c1c5467-23a6-4edf-87f9-930a20d03bc8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4c73822-1dfa-4eed-bf02-1123b0402755", "tag": "a7d62259-83d7-4cc4-b290-3fa8f2b03ade"}]} {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 23:01:11.625759 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [req-24e28bf1-2e00-4630-aa9a-5d626f9016f5 req-0c1c5467-23a6-4edf-87f9-930a20d03bc8 service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:11.626152 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [req-24e28bf1-2e00-4630-aa9a-5d626f9016f5 req-0c1c5467-23a6-4edf-87f9-930a20d03bc8 service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:11.638561 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.compute.server_external_events [req-24e28bf1-2e00-4630-aa9a-5d626f9016f5 req-0c1c5467-23a6-4edf-87f9-930a20d03bc8 service nova] Creating event network-changed:a7d62259-83d7-4cc4-b290-3fa8f2b03ade for instance f4c73822-1dfa-4eed-bf02-1123b0402755 on hv-cinder-84623 Jun 16 23:01:11.643593 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [req-24e28bf1-2e00-4630-aa9a-5d626f9016f5 req-0c1c5467-23a6-4edf-87f9-930a20d03bc8 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049484 Jun 16 23:01:11.644733 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 27/54] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 23:01:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 23:01:11.666687 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-5340f1bd-5e37-4c4f-a503-b7706f73b413 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:01:11.667295 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-5340f1bd-5e37-4c4f-a503-b7706f73b413 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] [instance: f4c73822-1dfa-4eed-bf02-1123b0402755] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:01:11.673496 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-5340f1bd-5e37-4c4f-a503-b7706f73b413 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:11.673944 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-5340f1bd-5e37-4c4f-a503-b7706f73b413 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:11.674809 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-5340f1bd-5e37-4c4f-a503-b7706f73b413 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:11.675770 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-5340f1bd-5e37-4c4f-a503-b7706f73b413 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:11.805939 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-5340f1bd-5e37-4c4f-a503-b7706f73b413 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a993f5d14b64fccad723abecfcadf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b1be8431b0434d8bd6abca293127d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:11.813229 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-5340f1bd-5e37-4c4f-a503-b7706f73b413 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] 10.222.0.17 "GET /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755" status: 200 len: 1363 microversion: 2.1 time: 0.150495 Jun 16 23:01:11.813791 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 28/55] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:01:11 2022] GET /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755 => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:01:12.055413 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-63c59fa9-8c0b-41d0-b8c9-3d4c0353c80b tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:01:12.056105 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-63c59fa9-8c0b-41d0-b8c9-3d4c0353c80b tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] [instance: d40a3e67-031a-4ad7-bd79-7c7d9a3bece9] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:01:12.062316 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-63c59fa9-8c0b-41d0-b8c9-3d4c0353c80b tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:12.062800 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-63c59fa9-8c0b-41d0-b8c9-3d4c0353c80b tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:12.063562 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-63c59fa9-8c0b-41d0-b8c9-3d4c0353c80b tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:12.064002 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-63c59fa9-8c0b-41d0-b8c9-3d4c0353c80b tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:12.102937 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-2329dd36-833e-482e-9250-516828d8bee1 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:01:12.103672 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-2329dd36-833e-482e-9250-516828d8bee1 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] [instance: 5cfd118b-cc42-4dbe-93f1-784454892318] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:01:12.110072 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-2329dd36-833e-482e-9250-516828d8bee1 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:12.110530 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-2329dd36-833e-482e-9250-516828d8bee1 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:12.111335 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-2329dd36-833e-482e-9250-516828d8bee1 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:12.111777 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-2329dd36-833e-482e-9250-516828d8bee1 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:12.185703 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-2329dd36-833e-482e-9250-516828d8bee1 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3a2d16133b4af8a208682de8a7d111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0526c12e8bc947209e24daf5ddfad7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:12.193888 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-2329dd36-833e-482e-9250-516828d8bee1 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] 10.222.0.17 "GET /compute/v2.1/servers/5cfd118b-cc42-4dbe-93f1-784454892318" status: 200 len: 1294 microversion: 2.1 time: 0.094660 Jun 16 23:01:12.194460 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 29/56] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:01:12 2022] GET /compute/v2.1/servers/5cfd118b-cc42-4dbe-93f1-784454892318 => generated 1294 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:01:12.215845 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-63c59fa9-8c0b-41d0-b8c9-3d4c0353c80b tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a6c4623c5f471b8241257180b64d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2300d78ad8244e3be17c1f388603de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:12.223376 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-63c59fa9-8c0b-41d0-b8c9-3d4c0353c80b tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] 10.222.0.17 "GET /compute/v2.1/servers/d40a3e67-031a-4ad7-bd79-7c7d9a3bece9" status: 200 len: 1314 microversion: 2.1 time: 0.172199 Jun 16 23:01:12.223933 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 28/57] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:01:12 2022] GET /compute/v2.1/servers/d40a3e67-031a-4ad7-bd79-7c7d9a3bece9 => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:01:12.283890 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-ff0cde87-9e8c-4517-80a6-590287a83899 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:01:12.285003 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-ff0cde87-9e8c-4517-80a6-590287a83899 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 46f43909-d681-4938-8253-5080b626e169] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:01:12.291284 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-ff0cde87-9e8c-4517-80a6-590287a83899 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:12.291777 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-ff0cde87-9e8c-4517-80a6-590287a83899 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:12.292595 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-ff0cde87-9e8c-4517-80a6-590287a83899 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:12.293043 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-ff0cde87-9e8c-4517-80a6-590287a83899 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:12.353616 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-ff0cde87-9e8c-4517-80a6-590287a83899 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:12.361635 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-ff0cde87-9e8c-4517-80a6-590287a83899 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:12.363200 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-ff0cde87-9e8c-4517-80a6-590287a83899 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:12.364298 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-ff0cde87-9e8c-4517-80a6-590287a83899 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169" status: 200 len: 1334 microversion: 2.20 time: 0.084319 Jun 16 23:01:12.364853 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 30/58] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 23:01:12 2022] GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169 => generated 1334 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 23:01:12.369577 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-4bef128d-0832-4d3b-8c30-fea62883cba7 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:01:12.370219 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-4bef128d-0832-4d3b-8c30-fea62883cba7 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] [instance: c2b8ba99-d845-4fca-b9e7-fc77ac91a601] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:01:12.376370 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-4bef128d-0832-4d3b-8c30-fea62883cba7 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:12.376821 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-4bef128d-0832-4d3b-8c30-fea62883cba7 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:12.377579 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-4bef128d-0832-4d3b-8c30-fea62883cba7 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:12.378538 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-4bef128d-0832-4d3b-8c30-fea62883cba7 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:12.514340 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-4bef128d-0832-4d3b-8c30-fea62883cba7 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '243e592fbf1844d89f55dd5035a684f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60447df5461141e883d207e028b74bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:12.519187 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-4bef128d-0832-4d3b-8c30-fea62883cba7 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] 10.222.0.17 "GET /compute/v2.1/servers/c2b8ba99-d845-4fca-b9e7-fc77ac91a601" status: 200 len: 1322 microversion: 2.1 time: 0.153050 Jun 16 23:01:12.519722 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 29/59] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:01:12 2022] GET /compute/v2.1/servers/c2b8ba99-d845-4fca-b9e7-fc77ac91a601 => generated 1322 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 23:01:12.829210 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-4e37af12-1d59-463e-9da1-65fe8adca5ed tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:01:12.829859 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-4e37af12-1d59-463e-9da1-65fe8adca5ed tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] [instance: f4c73822-1dfa-4eed-bf02-1123b0402755] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:01:12.833341 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG dbcounter [-] [117563] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=117563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 23:01:12.837361 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-4e37af12-1d59-463e-9da1-65fe8adca5ed tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:12.837815 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-4e37af12-1d59-463e-9da1-65fe8adca5ed tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:12.838584 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-4e37af12-1d59-463e-9da1-65fe8adca5ed tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:12.839171 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-4e37af12-1d59-463e-9da1-65fe8adca5ed tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:12.971027 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-4e37af12-1d59-463e-9da1-65fe8adca5ed tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a993f5d14b64fccad723abecfcadf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b1be8431b0434d8bd6abca293127d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:12.979085 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-4e37af12-1d59-463e-9da1-65fe8adca5ed tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] 10.222.0.17 "GET /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755" status: 200 len: 1363 microversion: 2.1 time: 0.153663 Jun 16 23:01:12.979650 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 31/60] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:01:12 2022] GET /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755 => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:01:13.211086 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-b9671e00-18dc-4989-bb01-564852525620 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:01:13.211689 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-b9671e00-18dc-4989-bb01-564852525620 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] [instance: 5cfd118b-cc42-4dbe-93f1-784454892318] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:01:13.217669 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-b9671e00-18dc-4989-bb01-564852525620 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:13.218151 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-b9671e00-18dc-4989-bb01-564852525620 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:13.218936 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-b9671e00-18dc-4989-bb01-564852525620 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:13.219369 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-b9671e00-18dc-4989-bb01-564852525620 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:13.239486 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-38652ed3-54fa-43be-ad8f-918657f88b15 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:01:13.240314 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-38652ed3-54fa-43be-ad8f-918657f88b15 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] [instance: d40a3e67-031a-4ad7-bd79-7c7d9a3bece9] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:01:13.246938 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-38652ed3-54fa-43be-ad8f-918657f88b15 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:13.247474 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-38652ed3-54fa-43be-ad8f-918657f88b15 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:13.248249 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-38652ed3-54fa-43be-ad8f-918657f88b15 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:13.248690 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-38652ed3-54fa-43be-ad8f-918657f88b15 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:13.281277 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-b9671e00-18dc-4989-bb01-564852525620 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3a2d16133b4af8a208682de8a7d111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0526c12e8bc947209e24daf5ddfad7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:13.289620 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-b9671e00-18dc-4989-bb01-564852525620 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] 10.222.0.17 "GET /compute/v2.1/servers/5cfd118b-cc42-4dbe-93f1-784454892318" status: 200 len: 1294 microversion: 2.1 time: 0.082280 Jun 16 23:01:13.290332 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 30/61] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:01:13 2022] GET /compute/v2.1/servers/5cfd118b-cc42-4dbe-93f1-784454892318 => generated 1294 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:01:13.381369 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-64e20ef3-ca18-4818-9bf7-f2ab6065a205 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:01:13.382001 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-64e20ef3-ca18-4818-9bf7-f2ab6065a205 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 46f43909-d681-4938-8253-5080b626e169] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:01:13.387241 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-38652ed3-54fa-43be-ad8f-918657f88b15 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a6c4623c5f471b8241257180b64d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2300d78ad8244e3be17c1f388603de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:13.388858 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-64e20ef3-ca18-4818-9bf7-f2ab6065a205 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:13.389374 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-64e20ef3-ca18-4818-9bf7-f2ab6065a205 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:13.390242 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-64e20ef3-ca18-4818-9bf7-f2ab6065a205 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:13.390806 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-64e20ef3-ca18-4818-9bf7-f2ab6065a205 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:13.395917 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-38652ed3-54fa-43be-ad8f-918657f88b15 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] 10.222.0.17 "GET /compute/v2.1/servers/d40a3e67-031a-4ad7-bd79-7c7d9a3bece9" status: 200 len: 1314 microversion: 2.1 time: 0.160349 Jun 16 23:01:13.396691 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 32/62] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:01:13 2022] GET /compute/v2.1/servers/d40a3e67-031a-4ad7-bd79-7c7d9a3bece9 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 23:01:13.453014 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-64e20ef3-ca18-4818-9bf7-f2ab6065a205 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:13.461347 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-64e20ef3-ca18-4818-9bf7-f2ab6065a205 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:13.462893 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-64e20ef3-ca18-4818-9bf7-f2ab6065a205 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:13.463985 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-64e20ef3-ca18-4818-9bf7-f2ab6065a205 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169" status: 200 len: 1334 microversion: 2.20 time: 0.086638 Jun 16 23:01:13.464748 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 31/63] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 23:01:13 2022] GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169 => generated 1334 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 23:01:13.536250 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-5566b5e3-5d3c-4534-92a1-aa9eac0f4e59 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:01:13.537123 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-5566b5e3-5d3c-4534-92a1-aa9eac0f4e59 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] [instance: c2b8ba99-d845-4fca-b9e7-fc77ac91a601] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:01:13.543357 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-5566b5e3-5d3c-4534-92a1-aa9eac0f4e59 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:13.543862 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-5566b5e3-5d3c-4534-92a1-aa9eac0f4e59 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:13.544694 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-5566b5e3-5d3c-4534-92a1-aa9eac0f4e59 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:13.545170 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-5566b5e3-5d3c-4534-92a1-aa9eac0f4e59 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:13.734167 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-5566b5e3-5d3c-4534-92a1-aa9eac0f4e59 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '243e592fbf1844d89f55dd5035a684f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60447df5461141e883d207e028b74bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:13.742318 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-5566b5e3-5d3c-4534-92a1-aa9eac0f4e59 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] 10.222.0.17 "GET /compute/v2.1/servers/c2b8ba99-d845-4fca-b9e7-fc77ac91a601" status: 200 len: 1322 microversion: 2.1 time: 0.210047 Jun 16 23:01:13.742968 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 33/64] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:01:13 2022] GET /compute/v2.1/servers/c2b8ba99-d845-4fca-b9e7-fc77ac91a601 => generated 1322 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:01:14.000606 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-91044b5b-2270-4174-9890-b285f77171b4 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:01:14.001662 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-91044b5b-2270-4174-9890-b285f77171b4 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] [instance: f4c73822-1dfa-4eed-bf02-1123b0402755] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:01:14.012460 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-91044b5b-2270-4174-9890-b285f77171b4 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:14.015047 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-91044b5b-2270-4174-9890-b285f77171b4 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:14.017748 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-91044b5b-2270-4174-9890-b285f77171b4 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:14.019283 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-91044b5b-2270-4174-9890-b285f77171b4 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:14.305984 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-a1ca855e-cc41-473a-9a28-4bb7de63a353 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:01:14.306794 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-a1ca855e-cc41-473a-9a28-4bb7de63a353 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] [instance: 5cfd118b-cc42-4dbe-93f1-784454892318] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:01:14.312851 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-a1ca855e-cc41-473a-9a28-4bb7de63a353 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:14.313387 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-a1ca855e-cc41-473a-9a28-4bb7de63a353 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:14.314263 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-a1ca855e-cc41-473a-9a28-4bb7de63a353 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:14.314811 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-a1ca855e-cc41-473a-9a28-4bb7de63a353 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:14.416265 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-a1ca855e-cc41-473a-9a28-4bb7de63a353 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3a2d16133b4af8a208682de8a7d111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0526c12e8bc947209e24daf5ddfad7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:14.424051 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-a1ca855e-cc41-473a-9a28-4bb7de63a353 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] 10.222.0.17 "GET /compute/v2.1/servers/5cfd118b-cc42-4dbe-93f1-784454892318" status: 200 len: 1300 microversion: 2.1 time: 0.121927 Jun 16 23:01:14.424820 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 34/65] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:01:14 2022] GET /compute/v2.1/servers/5cfd118b-cc42-4dbe-93f1-784454892318 => generated 1300 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 23:01:14.425910 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-91044b5b-2270-4174-9890-b285f77171b4 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a993f5d14b64fccad723abecfcadf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b1be8431b0434d8bd6abca293127d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:14.430125 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-cdbeb2d7-295e-4f69-91aa-68e1e6f620a8 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:01:14.430761 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-cdbeb2d7-295e-4f69-91aa-68e1e6f620a8 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] [instance: d40a3e67-031a-4ad7-bd79-7c7d9a3bece9] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:01:14.434383 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-91044b5b-2270-4174-9890-b285f77171b4 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] 10.222.0.17 "GET /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755" status: 200 len: 1363 microversion: 2.1 time: 0.439710 Jun 16 23:01:14.437027 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-cdbeb2d7-295e-4f69-91aa-68e1e6f620a8 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:14.437474 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-cdbeb2d7-295e-4f69-91aa-68e1e6f620a8 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:14.437971 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 32/66] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:01:13 2022] GET /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755 => generated 1363 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:01:14.438898 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-cdbeb2d7-295e-4f69-91aa-68e1e6f620a8 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:14.439338 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-cdbeb2d7-295e-4f69-91aa-68e1e6f620a8 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:14.484087 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-f77d3d64-f2c2-44e3-a63d-460a84696dba tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:01:14.484087 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-f77d3d64-f2c2-44e3-a63d-460a84696dba tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 46f43909-d681-4938-8253-5080b626e169] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:01:14.489549 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-f77d3d64-f2c2-44e3-a63d-460a84696dba tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:14.489931 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-f77d3d64-f2c2-44e3-a63d-460a84696dba tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:14.490752 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-f77d3d64-f2c2-44e3-a63d-460a84696dba tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:14.491216 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-f77d3d64-f2c2-44e3-a63d-460a84696dba tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:14.573046 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-f77d3d64-f2c2-44e3-a63d-460a84696dba tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:14.583368 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-f77d3d64-f2c2-44e3-a63d-460a84696dba tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:14.584883 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-f77d3d64-f2c2-44e3-a63d-460a84696dba tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:14.586247 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-f77d3d64-f2c2-44e3-a63d-460a84696dba tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169" status: 200 len: 1342 microversion: 2.20 time: 0.108469 Jun 16 23:01:14.587335 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 33/67] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 23:01:14 2022] GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169 => generated 1342 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 23:01:14.620859 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-cdbeb2d7-295e-4f69-91aa-68e1e6f620a8 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a6c4623c5f471b8241257180b64d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2300d78ad8244e3be17c1f388603de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:14.630360 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-cdbeb2d7-295e-4f69-91aa-68e1e6f620a8 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] 10.222.0.17 "GET /compute/v2.1/servers/d40a3e67-031a-4ad7-bd79-7c7d9a3bece9" status: 200 len: 1314 microversion: 2.1 time: 0.204573 Jun 16 23:01:14.631195 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 35/68] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:01:14 2022] GET /compute/v2.1/servers/d40a3e67-031a-4ad7-bd79-7c7d9a3bece9 => generated 1314 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:01:14.760586 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-caef5269-de21-4bc8-a1e0-c16dea6fdde0 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:01:14.761915 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-caef5269-de21-4bc8-a1e0-c16dea6fdde0 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] [instance: c2b8ba99-d845-4fca-b9e7-fc77ac91a601] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:01:14.770536 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-caef5269-de21-4bc8-a1e0-c16dea6fdde0 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:14.772029 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-caef5269-de21-4bc8-a1e0-c16dea6fdde0 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:14.773794 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-caef5269-de21-4bc8-a1e0-c16dea6fdde0 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:14.774661 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-caef5269-de21-4bc8-a1e0-c16dea6fdde0 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:14.935704 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-caef5269-de21-4bc8-a1e0-c16dea6fdde0 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '243e592fbf1844d89f55dd5035a684f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60447df5461141e883d207e028b74bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:14.944292 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-caef5269-de21-4bc8-a1e0-c16dea6fdde0 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] 10.222.0.17 "GET /compute/v2.1/servers/c2b8ba99-d845-4fca-b9e7-fc77ac91a601" status: 200 len: 1322 microversion: 2.1 time: 0.188717 Jun 16 23:01:14.944844 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 34/69] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:01:14 2022] GET /compute/v2.1/servers/c2b8ba99-d845-4fca-b9e7-fc77ac91a601 => generated 1322 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:01:15.440844 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-33a6664a-47e6-4d9f-920a-eadae9af1eb4 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:01:15.441484 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-33a6664a-47e6-4d9f-920a-eadae9af1eb4 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] [instance: 5cfd118b-cc42-4dbe-93f1-784454892318] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:01:15.447657 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-33a6664a-47e6-4d9f-920a-eadae9af1eb4 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:15.448109 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-33a6664a-47e6-4d9f-920a-eadae9af1eb4 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:15.448884 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-33a6664a-47e6-4d9f-920a-eadae9af1eb4 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:15.449321 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-33a6664a-47e6-4d9f-920a-eadae9af1eb4 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:15.455355 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-4a6909da-e47c-46a7-af35-a7be86db38e4 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:01:15.456576 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-4a6909da-e47c-46a7-af35-a7be86db38e4 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] [instance: f4c73822-1dfa-4eed-bf02-1123b0402755] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:01:15.462777 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-4a6909da-e47c-46a7-af35-a7be86db38e4 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:15.463411 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-4a6909da-e47c-46a7-af35-a7be86db38e4 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:15.464178 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-4a6909da-e47c-46a7-af35-a7be86db38e4 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:15.464791 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-4a6909da-e47c-46a7-af35-a7be86db38e4 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:15.532957 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-33a6664a-47e6-4d9f-920a-eadae9af1eb4 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3a2d16133b4af8a208682de8a7d111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0526c12e8bc947209e24daf5ddfad7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:15.541428 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-33a6664a-47e6-4d9f-920a-eadae9af1eb4 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] 10.222.0.17 "GET /compute/v2.1/servers/5cfd118b-cc42-4dbe-93f1-784454892318" status: 200 len: 1300 microversion: 2.1 time: 0.104671 Jun 16 23:01:15.542004 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 36/70] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:01:15 2022] GET /compute/v2.1/servers/5cfd118b-cc42-4dbe-93f1-784454892318 => generated 1300 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:01:15.604550 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-4c6af8ee-bf35-4e42-babc-e872f6455fcc tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:01:15.605157 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-4c6af8ee-bf35-4e42-babc-e872f6455fcc tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 46f43909-d681-4938-8253-5080b626e169] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:01:15.611525 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-4c6af8ee-bf35-4e42-babc-e872f6455fcc tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:15.612345 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-4c6af8ee-bf35-4e42-babc-e872f6455fcc tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:15.613106 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-4c6af8ee-bf35-4e42-babc-e872f6455fcc tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:15.613546 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-4c6af8ee-bf35-4e42-babc-e872f6455fcc tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:15.615334 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-4a6909da-e47c-46a7-af35-a7be86db38e4 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a993f5d14b64fccad723abecfcadf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b1be8431b0434d8bd6abca293127d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:15.623467 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-4a6909da-e47c-46a7-af35-a7be86db38e4 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] 10.222.0.17 "GET /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755" status: 200 len: 1363 microversion: 2.1 time: 0.172105 Jun 16 23:01:15.624230 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 35/71] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:01:15 2022] GET /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755 => generated 1363 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 23:01:15.649291 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-45ef7533-c731-4328-8ef7-98ee24bd95fb tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:01:15.650550 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-45ef7533-c731-4328-8ef7-98ee24bd95fb tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] [instance: d40a3e67-031a-4ad7-bd79-7c7d9a3bece9] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:01:15.658856 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-45ef7533-c731-4328-8ef7-98ee24bd95fb tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:15.659738 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-45ef7533-c731-4328-8ef7-98ee24bd95fb tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:15.660685 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-45ef7533-c731-4328-8ef7-98ee24bd95fb tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:15.661153 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-45ef7533-c731-4328-8ef7-98ee24bd95fb tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:15.683526 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-4c6af8ee-bf35-4e42-babc-e872f6455fcc tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:15.692862 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-4c6af8ee-bf35-4e42-babc-e872f6455fcc tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:15.694533 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-4c6af8ee-bf35-4e42-babc-e872f6455fcc tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:15.695841 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-4c6af8ee-bf35-4e42-babc-e872f6455fcc tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169" status: 200 len: 1342 microversion: 2.20 time: 0.095154 Jun 16 23:01:15.696905 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 37/72] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 23:01:15 2022] GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169 => generated 1342 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 23:01:15.803688 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-45ef7533-c731-4328-8ef7-98ee24bd95fb tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a6c4623c5f471b8241257180b64d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2300d78ad8244e3be17c1f388603de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:15.811205 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-45ef7533-c731-4328-8ef7-98ee24bd95fb tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] 10.222.0.17 "GET /compute/v2.1/servers/d40a3e67-031a-4ad7-bd79-7c7d9a3bece9" status: 200 len: 1314 microversion: 2.1 time: 0.168075 Jun 16 23:01:15.811782 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 36/73] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:01:15 2022] GET /compute/v2.1/servers/d40a3e67-031a-4ad7-bd79-7c7d9a3bece9 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:01:15.962290 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-7ff75f04-c171-4a8d-a617-cdfab03d97fc tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:01:15.963472 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-7ff75f04-c171-4a8d-a617-cdfab03d97fc tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] [instance: c2b8ba99-d845-4fca-b9e7-fc77ac91a601] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:01:15.970000 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-7ff75f04-c171-4a8d-a617-cdfab03d97fc tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:15.970513 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-7ff75f04-c171-4a8d-a617-cdfab03d97fc tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:15.971717 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-7ff75f04-c171-4a8d-a617-cdfab03d97fc tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:15.972309 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-7ff75f04-c171-4a8d-a617-cdfab03d97fc tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:15.977103 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG dbcounter [-] [117563] Writing DB stats nova_cell1:SELECT=100 {{(pid=117563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 23:01:16.125182 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-7ff75f04-c171-4a8d-a617-cdfab03d97fc tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '243e592fbf1844d89f55dd5035a684f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60447df5461141e883d207e028b74bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:16.133888 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-7ff75f04-c171-4a8d-a617-cdfab03d97fc tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] 10.222.0.17 "GET /compute/v2.1/servers/c2b8ba99-d845-4fca-b9e7-fc77ac91a601" status: 200 len: 1322 microversion: 2.1 time: 0.176286 Jun 16 23:01:16.134408 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 38/74] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:01:15 2022] GET /compute/v2.1/servers/c2b8ba99-d845-4fca-b9e7-fc77ac91a601 => generated 1322 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:01:16.557338 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-dfe1cd66-9784-40f1-abea-17a4dd89a0c1 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:01:16.557971 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-dfe1cd66-9784-40f1-abea-17a4dd89a0c1 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] [instance: 5cfd118b-cc42-4dbe-93f1-784454892318] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:01:16.564442 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-dfe1cd66-9784-40f1-abea-17a4dd89a0c1 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:16.565812 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-dfe1cd66-9784-40f1-abea-17a4dd89a0c1 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:16.566641 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-dfe1cd66-9784-40f1-abea-17a4dd89a0c1 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:16.567095 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-dfe1cd66-9784-40f1-abea-17a4dd89a0c1 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:16.630333 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-dfe1cd66-9784-40f1-abea-17a4dd89a0c1 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3a2d16133b4af8a208682de8a7d111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0526c12e8bc947209e24daf5ddfad7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:16.636656 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG dbcounter [-] [117562] Writing DB stats nova_cell0:SELECT=12 {{(pid=117562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 23:01:16.639292 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-dfe1cd66-9784-40f1-abea-17a4dd89a0c1 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] 10.222.0.17 "GET /compute/v2.1/servers/5cfd118b-cc42-4dbe-93f1-784454892318" status: 200 len: 1300 microversion: 2.1 time: 0.086050 Jun 16 23:01:16.639872 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 37/75] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:01:16 2022] GET /compute/v2.1/servers/5cfd118b-cc42-4dbe-93f1-784454892318 => generated 1300 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:01:16.641984 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-3a33004a-9e0a-4612-bcc7-4389174551cf tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:01:16.643003 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-3a33004a-9e0a-4612-bcc7-4389174551cf tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] [instance: f4c73822-1dfa-4eed-bf02-1123b0402755] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:01:16.649029 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-3a33004a-9e0a-4612-bcc7-4389174551cf tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:16.649484 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-3a33004a-9e0a-4612-bcc7-4389174551cf tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:16.650282 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-3a33004a-9e0a-4612-bcc7-4389174551cf tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:16.650915 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-3a33004a-9e0a-4612-bcc7-4389174551cf tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:16.715280 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-413a4d40-c066-4d67-8eb7-f21f85e7fa7b tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:01:16.716232 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-413a4d40-c066-4d67-8eb7-f21f85e7fa7b tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 46f43909-d681-4938-8253-5080b626e169] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:01:16.723225 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-413a4d40-c066-4d67-8eb7-f21f85e7fa7b tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:16.723656 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-413a4d40-c066-4d67-8eb7-f21f85e7fa7b tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:16.724420 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-413a4d40-c066-4d67-8eb7-f21f85e7fa7b tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:16.724852 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-413a4d40-c066-4d67-8eb7-f21f85e7fa7b tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:16.798479 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-413a4d40-c066-4d67-8eb7-f21f85e7fa7b tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:16.807193 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-413a4d40-c066-4d67-8eb7-f21f85e7fa7b tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:16.809276 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-413a4d40-c066-4d67-8eb7-f21f85e7fa7b tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:16.811045 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-413a4d40-c066-4d67-8eb7-f21f85e7fa7b tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169" status: 200 len: 1342 microversion: 2.20 time: 0.099828 Jun 16 23:01:16.811595 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 38/76] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 23:01:16 2022] GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169 => generated 1342 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 23:01:16.816515 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-3a33004a-9e0a-4612-bcc7-4389174551cf tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a993f5d14b64fccad723abecfcadf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b1be8431b0434d8bd6abca293127d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:16.824546 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-3a33004a-9e0a-4612-bcc7-4389174551cf tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] 10.222.0.17 "GET /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755" status: 200 len: 1363 microversion: 2.1 time: 0.187024 Jun 16 23:01:16.825106 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 39/77] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:01:16 2022] GET /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755 => generated 1363 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 23:01:16.827695 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-d71060d7-ca58-4540-ba19-e2d9f6f97b2a tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:01:16.828705 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-d71060d7-ca58-4540-ba19-e2d9f6f97b2a tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] [instance: d40a3e67-031a-4ad7-bd79-7c7d9a3bece9] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:01:16.836486 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-d71060d7-ca58-4540-ba19-e2d9f6f97b2a tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:16.836934 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-d71060d7-ca58-4540-ba19-e2d9f6f97b2a tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:16.837865 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-d71060d7-ca58-4540-ba19-e2d9f6f97b2a tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:16.838302 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-d71060d7-ca58-4540-ba19-e2d9f6f97b2a tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:16.969455 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-d71060d7-ca58-4540-ba19-e2d9f6f97b2a tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a6c4623c5f471b8241257180b64d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2300d78ad8244e3be17c1f388603de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:16.977328 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-d71060d7-ca58-4540-ba19-e2d9f6f97b2a tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] 10.222.0.17 "GET /compute/v2.1/servers/d40a3e67-031a-4ad7-bd79-7c7d9a3bece9" status: 200 len: 1314 microversion: 2.1 time: 0.153696 Jun 16 23:01:16.977889 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 39/78] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:01:16 2022] GET /compute/v2.1/servers/d40a3e67-031a-4ad7-bd79-7c7d9a3bece9 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 23:01:17.150042 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-eb3d89ee-fb24-468b-b807-5f907e0c6ba4 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:01:17.150782 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-eb3d89ee-fb24-468b-b807-5f907e0c6ba4 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] [instance: c2b8ba99-d845-4fca-b9e7-fc77ac91a601] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:01:17.156811 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-eb3d89ee-fb24-468b-b807-5f907e0c6ba4 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:17.157267 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-eb3d89ee-fb24-468b-b807-5f907e0c6ba4 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:17.158149 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-eb3d89ee-fb24-468b-b807-5f907e0c6ba4 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:17.158481 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-eb3d89ee-fb24-468b-b807-5f907e0c6ba4 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:17.269634 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG dbcounter [-] [117563] Writing DB stats nova_cell0:SELECT=6 {{(pid=117563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 23:01:17.294505 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-eb3d89ee-fb24-468b-b807-5f907e0c6ba4 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '243e592fbf1844d89f55dd5035a684f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60447df5461141e883d207e028b74bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:17.303029 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-eb3d89ee-fb24-468b-b807-5f907e0c6ba4 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] 10.222.0.17 "GET /compute/v2.1/servers/c2b8ba99-d845-4fca-b9e7-fc77ac91a601" status: 200 len: 1322 microversion: 2.1 time: 0.156641 Jun 16 23:01:17.303600 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 40/79] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:01:17 2022] GET /compute/v2.1/servers/c2b8ba99-d845-4fca-b9e7-fc77ac91a601 => generated 1322 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:01:17.656972 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-932d4b04-5b6d-4dae-8d03-6f4af6d60d7b tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:01:17.658517 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-932d4b04-5b6d-4dae-8d03-6f4af6d60d7b tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] [instance: 5cfd118b-cc42-4dbe-93f1-784454892318] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:01:17.664757 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-932d4b04-5b6d-4dae-8d03-6f4af6d60d7b tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:17.665212 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-932d4b04-5b6d-4dae-8d03-6f4af6d60d7b tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:17.666260 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-932d4b04-5b6d-4dae-8d03-6f4af6d60d7b tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:17.666966 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-932d4b04-5b6d-4dae-8d03-6f4af6d60d7b tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:17.734214 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-932d4b04-5b6d-4dae-8d03-6f4af6d60d7b tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3a2d16133b4af8a208682de8a7d111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0526c12e8bc947209e24daf5ddfad7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:17.744271 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-932d4b04-5b6d-4dae-8d03-6f4af6d60d7b tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] 10.222.0.17 "GET /compute/v2.1/servers/5cfd118b-cc42-4dbe-93f1-784454892318" status: 200 len: 1300 microversion: 2.1 time: 0.091726 Jun 16 23:01:17.746007 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 40/80] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:01:17 2022] GET /compute/v2.1/servers/5cfd118b-cc42-4dbe-93f1-784454892318 => generated 1300 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:01:17.836199 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-1231002c-606e-4d13-bf86-156e10d6daec tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:01:17.838542 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-1231002c-606e-4d13-bf86-156e10d6daec tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 46f43909-d681-4938-8253-5080b626e169] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:01:17.842756 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-a49c2887-96e1-4b0f-99b1-0ad782115190 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:01:17.843446 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-a49c2887-96e1-4b0f-99b1-0ad782115190 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] [instance: f4c73822-1dfa-4eed-bf02-1123b0402755] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:01:17.853338 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG dbcounter [-] [117562] Writing DB stats nova_cell0:SELECT=42 {{(pid=117562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 23:01:17.855130 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-a49c2887-96e1-4b0f-99b1-0ad782115190 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:17.855654 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-a49c2887-96e1-4b0f-99b1-0ad782115190 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:17.856501 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-a49c2887-96e1-4b0f-99b1-0ad782115190 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:17.858738 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-a49c2887-96e1-4b0f-99b1-0ad782115190 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:17.869249 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG dbcounter [-] [117562] Writing DB stats nova_cell1:SELECT=100 {{(pid=117562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 23:01:17.873154 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG dbcounter [-] [117563] Writing DB stats nova_cell0:SELECT=4 {{(pid=117563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 23:01:17.889561 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-1231002c-606e-4d13-bf86-156e10d6daec tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:17.890041 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-1231002c-606e-4d13-bf86-156e10d6daec tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:17.896087 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-1231002c-606e-4d13-bf86-156e10d6daec tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:17.896953 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-1231002c-606e-4d13-bf86-156e10d6daec tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:18.135780 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-1231002c-606e-4d13-bf86-156e10d6daec tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:18.145581 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-1231002c-606e-4d13-bf86-156e10d6daec tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:18.147699 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-1231002c-606e-4d13-bf86-156e10d6daec tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:18.149464 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-1231002c-606e-4d13-bf86-156e10d6daec tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169" status: 200 len: 1342 microversion: 2.20 time: 0.324047 Jun 16 23:01:18.160162 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 41/81] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 23:01:17 2022] GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169 => generated 1342 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 23:01:18.165923 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-3c524fd2-ef3e-4797-9a2a-2b6e1a2d1405 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:01:18.166861 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-3c524fd2-ef3e-4797-9a2a-2b6e1a2d1405 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] [instance: d40a3e67-031a-4ad7-bd79-7c7d9a3bece9] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:01:18.175975 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-3c524fd2-ef3e-4797-9a2a-2b6e1a2d1405 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:18.176432 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-3c524fd2-ef3e-4797-9a2a-2b6e1a2d1405 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:18.177221 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-3c524fd2-ef3e-4797-9a2a-2b6e1a2d1405 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:18.177735 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-3c524fd2-ef3e-4797-9a2a-2b6e1a2d1405 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:18.269947 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-a49c2887-96e1-4b0f-99b1-0ad782115190 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a993f5d14b64fccad723abecfcadf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b1be8431b0434d8bd6abca293127d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:18.287383 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-a49c2887-96e1-4b0f-99b1-0ad782115190 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] 10.222.0.17 "GET /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755" status: 200 len: 1363 microversion: 2.1 time: 0.444022 Jun 16 23:01:18.288098 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 41/82] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:01:17 2022] GET /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755 => generated 1363 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:01:18.320625 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-5b725b1a-039a-4ea7-9958-afea662b8209 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:01:18.321649 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-5b725b1a-039a-4ea7-9958-afea662b8209 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] [instance: c2b8ba99-d845-4fca-b9e7-fc77ac91a601] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:01:18.340422 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-5b725b1a-039a-4ea7-9958-afea662b8209 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:18.342050 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-5b725b1a-039a-4ea7-9958-afea662b8209 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:18.343531 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-5b725b1a-039a-4ea7-9958-afea662b8209 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:18.344267 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-5b725b1a-039a-4ea7-9958-afea662b8209 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:18.655908 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-3c524fd2-ef3e-4797-9a2a-2b6e1a2d1405 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a6c4623c5f471b8241257180b64d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2300d78ad8244e3be17c1f388603de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:18.663791 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-3c524fd2-ef3e-4797-9a2a-2b6e1a2d1405 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] 10.222.0.17 "GET /compute/v2.1/servers/d40a3e67-031a-4ad7-bd79-7c7d9a3bece9" status: 200 len: 1314 microversion: 2.1 time: 0.502268 Jun 16 23:01:18.664593 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 42/83] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:01:18 2022] GET /compute/v2.1/servers/d40a3e67-031a-4ad7-bd79-7c7d9a3bece9 => generated 1314 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:01:18.768124 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-7b1315a5-cb5d-4578-9ce6-8609a46dcdf6 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:01:18.768891 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-7b1315a5-cb5d-4578-9ce6-8609a46dcdf6 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] [instance: 5cfd118b-cc42-4dbe-93f1-784454892318] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:01:18.775965 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-7b1315a5-cb5d-4578-9ce6-8609a46dcdf6 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:18.777103 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-7b1315a5-cb5d-4578-9ce6-8609a46dcdf6 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:18.777916 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-7b1315a5-cb5d-4578-9ce6-8609a46dcdf6 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:18.778511 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-7b1315a5-cb5d-4578-9ce6-8609a46dcdf6 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:18.905858 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-7b1315a5-cb5d-4578-9ce6-8609a46dcdf6 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3a2d16133b4af8a208682de8a7d111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0526c12e8bc947209e24daf5ddfad7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:18.921295 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-5b725b1a-039a-4ea7-9958-afea662b8209 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '243e592fbf1844d89f55dd5035a684f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60447df5461141e883d207e028b74bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:18.939393 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-5b725b1a-039a-4ea7-9958-afea662b8209 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] 10.222.0.17 "GET /compute/v2.1/servers/c2b8ba99-d845-4fca-b9e7-fc77ac91a601" status: 200 len: 1322 microversion: 2.1 time: 0.620702 Jun 16 23:01:18.941846 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 42/84] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:01:18 2022] GET /compute/v2.1/servers/c2b8ba99-d845-4fca-b9e7-fc77ac91a601 => generated 1322 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 23:01:18.944299 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-7b1315a5-cb5d-4578-9ce6-8609a46dcdf6 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] 10.222.0.17 "GET /compute/v2.1/servers/5cfd118b-cc42-4dbe-93f1-784454892318" status: 200 len: 1300 microversion: 2.1 time: 0.180723 Jun 16 23:01:18.955912 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 43/85] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:01:18 2022] GET /compute/v2.1/servers/5cfd118b-cc42-4dbe-93f1-784454892318 => generated 1300 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 23:01:19.168407 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-533a09e6-4992-49ab-be49-c8b478ef0701 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:01:19.169146 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-533a09e6-4992-49ab-be49-c8b478ef0701 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 46f43909-d681-4938-8253-5080b626e169] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:01:19.176687 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-533a09e6-4992-49ab-be49-c8b478ef0701 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:19.184862 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-533a09e6-4992-49ab-be49-c8b478ef0701 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:19.186200 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-533a09e6-4992-49ab-be49-c8b478ef0701 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:19.186982 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-533a09e6-4992-49ab-be49-c8b478ef0701 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:19.304029 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-22680e3b-7f43-4c0e-8966-12d961e6a5b1 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:01:19.304686 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-22680e3b-7f43-4c0e-8966-12d961e6a5b1 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] [instance: f4c73822-1dfa-4eed-bf02-1123b0402755] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:01:19.315448 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-22680e3b-7f43-4c0e-8966-12d961e6a5b1 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:19.317265 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-22680e3b-7f43-4c0e-8966-12d961e6a5b1 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:19.320983 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-22680e3b-7f43-4c0e-8966-12d961e6a5b1 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:19.321755 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-22680e3b-7f43-4c0e-8966-12d961e6a5b1 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:19.404961 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-533a09e6-4992-49ab-be49-c8b478ef0701 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:19.424562 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-533a09e6-4992-49ab-be49-c8b478ef0701 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:19.426204 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-533a09e6-4992-49ab-be49-c8b478ef0701 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:19.427452 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-533a09e6-4992-49ab-be49-c8b478ef0701 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169" status: 200 len: 1340 microversion: 2.20 time: 0.263789 Jun 16 23:01:19.432887 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 43/86] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 23:01:19 2022] GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169 => generated 1340 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 23:01:19.681778 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-85618611-c65d-40a1-9f47-6874d43cfb6a tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:01:19.682432 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-85618611-c65d-40a1-9f47-6874d43cfb6a tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] [instance: d40a3e67-031a-4ad7-bd79-7c7d9a3bece9] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:01:19.698772 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-85618611-c65d-40a1-9f47-6874d43cfb6a tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:19.699273 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-85618611-c65d-40a1-9f47-6874d43cfb6a tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:19.700086 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-85618611-c65d-40a1-9f47-6874d43cfb6a tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:19.700565 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-85618611-c65d-40a1-9f47-6874d43cfb6a tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:19.999346 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-22680e3b-7f43-4c0e-8966-12d961e6a5b1 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a993f5d14b64fccad723abecfcadf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b1be8431b0434d8bd6abca293127d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:20.007645 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-22680e3b-7f43-4c0e-8966-12d961e6a5b1 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] 10.222.0.17 "GET /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755" status: 200 len: 1363 microversion: 2.1 time: 0.707617 Jun 16 23:01:20.008503 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 44/87] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:01:19 2022] GET /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755 => generated 1363 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:01:20.096617 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [req-6ba8326a-cbe5-4b11-bfb1-80090303fa08 req-fe4e03e0-d4b7-4528-aaff-9d9cf8ea2c0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d40a3e67-031a-4ad7-bd79-7c7d9a3bece9", "name": "network-vif-plugged", "status": "completed", "tag": "d15996c2-23a1-4c1b-834d-20bf7a7f63af"}]} {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 23:01:20.108323 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-6ba8326a-cbe5-4b11-bfb1-80090303fa08 req-fe4e03e0-d4b7-4528-aaff-9d9cf8ea2c0b service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:20.109532 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-6ba8326a-cbe5-4b11-bfb1-80090303fa08 req-fe4e03e0-d4b7-4528-aaff-9d9cf8ea2c0b service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:20.122889 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.compute.server_external_events [req-6ba8326a-cbe5-4b11-bfb1-80090303fa08 req-fe4e03e0-d4b7-4528-aaff-9d9cf8ea2c0b service nova] Creating event network-vif-plugged:d15996c2-23a1-4c1b-834d-20bf7a7f63af for instance d40a3e67-031a-4ad7-bd79-7c7d9a3bece9 on hv-cinder-84623 Jun 16 23:01:20.128834 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [req-6ba8326a-cbe5-4b11-bfb1-80090303fa08 req-fe4e03e0-d4b7-4528-aaff-9d9cf8ea2c0b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118947 Jun 16 23:01:20.133584 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 45/88] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 23:01:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 23:01:20.139383 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-a7cfc0fe-ab23-4715-9bab-0ddba535d889 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:01:20.140142 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-a7cfc0fe-ab23-4715-9bab-0ddba535d889 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] [instance: c2b8ba99-d845-4fca-b9e7-fc77ac91a601] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:01:20.147737 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-a7cfc0fe-ab23-4715-9bab-0ddba535d889 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:20.148261 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-a7cfc0fe-ab23-4715-9bab-0ddba535d889 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:20.149074 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-a7cfc0fe-ab23-4715-9bab-0ddba535d889 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:20.149509 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-a7cfc0fe-ab23-4715-9bab-0ddba535d889 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:20.175143 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-85618611-c65d-40a1-9f47-6874d43cfb6a tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a6c4623c5f471b8241257180b64d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2300d78ad8244e3be17c1f388603de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:20.183132 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-85618611-c65d-40a1-9f47-6874d43cfb6a tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] 10.222.0.17 "GET /compute/v2.1/servers/d40a3e67-031a-4ad7-bd79-7c7d9a3bece9" status: 200 len: 1314 microversion: 2.1 time: 0.505291 Jun 16 23:01:20.183776 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 44/89] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:01:19 2022] GET /compute/v2.1/servers/d40a3e67-031a-4ad7-bd79-7c7d9a3bece9 => generated 1314 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 23:01:20.194557 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-6ae936ef-64a9-47c9-a013-4a66574b84cd tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:01:20.195283 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-6ae936ef-64a9-47c9-a013-4a66574b84cd tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] [instance: 5cfd118b-cc42-4dbe-93f1-784454892318] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:01:20.201673 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-6ae936ef-64a9-47c9-a013-4a66574b84cd tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:20.202123 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-6ae936ef-64a9-47c9-a013-4a66574b84cd tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:20.202954 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-6ae936ef-64a9-47c9-a013-4a66574b84cd tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:20.203398 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-6ae936ef-64a9-47c9-a013-4a66574b84cd tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:20.401115 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-a7cfc0fe-ab23-4715-9bab-0ddba535d889 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '243e592fbf1844d89f55dd5035a684f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60447df5461141e883d207e028b74bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:20.410457 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-a7cfc0fe-ab23-4715-9bab-0ddba535d889 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] 10.222.0.17 "GET /compute/v2.1/servers/c2b8ba99-d845-4fca-b9e7-fc77ac91a601" status: 200 len: 1322 microversion: 2.1 time: 0.275267 Jun 16 23:01:20.411355 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 46/90] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:01:20 2022] GET /compute/v2.1/servers/c2b8ba99-d845-4fca-b9e7-fc77ac91a601 => generated 1322 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:01:20.426413 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-6ae936ef-64a9-47c9-a013-4a66574b84cd tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3a2d16133b4af8a208682de8a7d111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0526c12e8bc947209e24daf5ddfad7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:20.434095 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-6ae936ef-64a9-47c9-a013-4a66574b84cd tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] 10.222.0.17 "GET /compute/v2.1/servers/5cfd118b-cc42-4dbe-93f1-784454892318" status: 200 len: 1367 microversion: 2.1 time: 0.245966 Jun 16 23:01:20.434702 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 45/91] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:01:20 2022] GET /compute/v2.1/servers/5cfd118b-cc42-4dbe-93f1-784454892318 => generated 1367 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:01:20.446654 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-d3cd52d8-0586-45a1-9ec6-67f087bd0e2a tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:01:20.447754 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-d3cd52d8-0586-45a1-9ec6-67f087bd0e2a tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 46f43909-d681-4938-8253-5080b626e169] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:01:20.456016 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-d3cd52d8-0586-45a1-9ec6-67f087bd0e2a tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:20.456470 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-d3cd52d8-0586-45a1-9ec6-67f087bd0e2a tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:20.457317 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-d3cd52d8-0586-45a1-9ec6-67f087bd0e2a tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:20.457706 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-d3cd52d8-0586-45a1-9ec6-67f087bd0e2a tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:20.597973 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-d3cd52d8-0586-45a1-9ec6-67f087bd0e2a tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:20.606295 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-d3cd52d8-0586-45a1-9ec6-67f087bd0e2a tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:20.608076 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-d3cd52d8-0586-45a1-9ec6-67f087bd0e2a tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:20.609175 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-d3cd52d8-0586-45a1-9ec6-67f087bd0e2a tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169" status: 200 len: 1406 microversion: 2.20 time: 0.167282 Jun 16 23:01:20.610047 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 47/92] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 23:01:20 2022] GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169 => generated 1406 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 23:01:21.025016 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-9f12cd04-b586-4091-b9db-fcc80de2c949 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:01:21.025652 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-9f12cd04-b586-4091-b9db-fcc80de2c949 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] [instance: f4c73822-1dfa-4eed-bf02-1123b0402755] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:01:21.031766 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-9f12cd04-b586-4091-b9db-fcc80de2c949 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:21.032219 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-9f12cd04-b586-4091-b9db-fcc80de2c949 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:21.033345 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-9f12cd04-b586-4091-b9db-fcc80de2c949 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:21.034063 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-9f12cd04-b586-4091-b9db-fcc80de2c949 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:21.176238 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-9f12cd04-b586-4091-b9db-fcc80de2c949 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a993f5d14b64fccad723abecfcadf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b1be8431b0434d8bd6abca293127d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:21.189238 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-9f12cd04-b586-4091-b9db-fcc80de2c949 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] 10.222.0.17 "GET /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755" status: 200 len: 1363 microversion: 2.1 time: 0.168375 Jun 16 23:01:21.189843 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 46/93] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:01:21 2022] GET /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755 => generated 1363 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:01:21.200221 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-9addcab5-60da-4250-963f-a2bf239c30bd tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:01:21.200831 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-9addcab5-60da-4250-963f-a2bf239c30bd tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] [instance: d40a3e67-031a-4ad7-bd79-7c7d9a3bece9] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:01:21.207393 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-9addcab5-60da-4250-963f-a2bf239c30bd tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:21.208033 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-9addcab5-60da-4250-963f-a2bf239c30bd tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:21.208945 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-9addcab5-60da-4250-963f-a2bf239c30bd tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:21.209514 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-9addcab5-60da-4250-963f-a2bf239c30bd tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:21.364233 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-9addcab5-60da-4250-963f-a2bf239c30bd tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a6c4623c5f471b8241257180b64d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2300d78ad8244e3be17c1f388603de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:21.371853 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-9addcab5-60da-4250-963f-a2bf239c30bd tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] 10.222.0.17 "GET /compute/v2.1/servers/d40a3e67-031a-4ad7-bd79-7c7d9a3bece9" status: 200 len: 1314 microversion: 2.1 time: 0.175336 Jun 16 23:01:21.372433 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 48/94] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:01:21 2022] GET /compute/v2.1/servers/d40a3e67-031a-4ad7-bd79-7c7d9a3bece9 => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:01:21.428483 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-7a14d46e-8687-49fd-ba85-073967b54fb6 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:01:21.429101 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-7a14d46e-8687-49fd-ba85-073967b54fb6 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] [instance: c2b8ba99-d845-4fca-b9e7-fc77ac91a601] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:01:21.435215 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-7a14d46e-8687-49fd-ba85-073967b54fb6 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:21.435879 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-7a14d46e-8687-49fd-ba85-073967b54fb6 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:21.436651 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-7a14d46e-8687-49fd-ba85-073967b54fb6 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:21.437099 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-7a14d46e-8687-49fd-ba85-073967b54fb6 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:21.451341 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-63e6bddb-3a71-4d31-b89c-a4abb6a20427 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:01:21.452139 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-63e6bddb-3a71-4d31-b89c-a4abb6a20427 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] [instance: 5cfd118b-cc42-4dbe-93f1-784454892318] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:01:21.458777 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-63e6bddb-3a71-4d31-b89c-a4abb6a20427 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:21.459353 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-63e6bddb-3a71-4d31-b89c-a4abb6a20427 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:21.460274 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-63e6bddb-3a71-4d31-b89c-a4abb6a20427 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:21.460860 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-63e6bddb-3a71-4d31-b89c-a4abb6a20427 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:21.638187 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-7a14d46e-8687-49fd-ba85-073967b54fb6 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '243e592fbf1844d89f55dd5035a684f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60447df5461141e883d207e028b74bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:21.649459 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-7a14d46e-8687-49fd-ba85-073967b54fb6 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] 10.222.0.17 "GET /compute/v2.1/servers/c2b8ba99-d845-4fca-b9e7-fc77ac91a601" status: 200 len: 1322 microversion: 2.1 time: 0.225407 Jun 16 23:01:21.651153 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 47/95] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:01:21 2022] GET /compute/v2.1/servers/c2b8ba99-d845-4fca-b9e7-fc77ac91a601 => generated 1322 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:01:21.657115 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-2705c83f-876d-46be-b15b-ca77b12dbbc2 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:01:21.658176 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-2705c83f-876d-46be-b15b-ca77b12dbbc2 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 46f43909-d681-4938-8253-5080b626e169] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:01:21.665178 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-2705c83f-876d-46be-b15b-ca77b12dbbc2 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:21.665638 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-2705c83f-876d-46be-b15b-ca77b12dbbc2 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:21.666307 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-63e6bddb-3a71-4d31-b89c-a4abb6a20427 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3a2d16133b4af8a208682de8a7d111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0526c12e8bc947209e24daf5ddfad7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:21.666675 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-2705c83f-876d-46be-b15b-ca77b12dbbc2 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:21.667277 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-2705c83f-876d-46be-b15b-ca77b12dbbc2 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:21.680723 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-63e6bddb-3a71-4d31-b89c-a4abb6a20427 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] 10.222.0.17 "GET /compute/v2.1/servers/5cfd118b-cc42-4dbe-93f1-784454892318" status: 200 len: 1367 microversion: 2.1 time: 0.232618 Jun 16 23:01:21.682268 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 49/96] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:01:21 2022] GET /compute/v2.1/servers/5cfd118b-cc42-4dbe-93f1-784454892318 => generated 1367 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 23:01:21.820153 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-2705c83f-876d-46be-b15b-ca77b12dbbc2 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:21.828945 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-2705c83f-876d-46be-b15b-ca77b12dbbc2 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:21.830875 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-2705c83f-876d-46be-b15b-ca77b12dbbc2 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:21.832030 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-2705c83f-876d-46be-b15b-ca77b12dbbc2 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169" status: 200 len: 1406 microversion: 2.20 time: 0.179668 Jun 16 23:01:21.832758 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 48/97] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 23:01:21 2022] GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169 => generated 1406 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 23:01:22.207149 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-6e581508-952b-4518-bede-e21c146fae0b tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:01:22.207765 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-6e581508-952b-4518-bede-e21c146fae0b tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] [instance: f4c73822-1dfa-4eed-bf02-1123b0402755] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:01:22.214863 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-6e581508-952b-4518-bede-e21c146fae0b tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:22.215319 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-6e581508-952b-4518-bede-e21c146fae0b tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:22.216100 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-6e581508-952b-4518-bede-e21c146fae0b tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:22.216542 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-6e581508-952b-4518-bede-e21c146fae0b tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:22.363297 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-6e581508-952b-4518-bede-e21c146fae0b tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a993f5d14b64fccad723abecfcadf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b1be8431b0434d8bd6abca293127d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:22.372122 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-6e581508-952b-4518-bede-e21c146fae0b tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] 10.222.0.17 "GET /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755" status: 200 len: 1363 microversion: 2.1 time: 0.169806 Jun 16 23:01:22.372813 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 50/98] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:01:22 2022] GET /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755 => generated 1363 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:01:22.388994 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-1fb34bab-8bb8-4ef6-8180-3fd14814ce17 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:01:22.389648 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-1fb34bab-8bb8-4ef6-8180-3fd14814ce17 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] [instance: d40a3e67-031a-4ad7-bd79-7c7d9a3bece9] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:01:22.396117 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-1fb34bab-8bb8-4ef6-8180-3fd14814ce17 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:22.396498 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-1fb34bab-8bb8-4ef6-8180-3fd14814ce17 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:22.397280 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-1fb34bab-8bb8-4ef6-8180-3fd14814ce17 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:22.397713 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-1fb34bab-8bb8-4ef6-8180-3fd14814ce17 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:22.526482 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-1fb34bab-8bb8-4ef6-8180-3fd14814ce17 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a6c4623c5f471b8241257180b64d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2300d78ad8244e3be17c1f388603de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:22.537490 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-1fb34bab-8bb8-4ef6-8180-3fd14814ce17 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] 10.222.0.17 "GET /compute/v2.1/servers/d40a3e67-031a-4ad7-bd79-7c7d9a3bece9" status: 200 len: 1314 microversion: 2.1 time: 0.151836 Jun 16 23:01:22.537831 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 49/99] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:01:22 2022] GET /compute/v2.1/servers/d40a3e67-031a-4ad7-bd79-7c7d9a3bece9 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:01:22.668705 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-e2fcba5d-50d6-4853-ab6a-b74ccabe129e tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:01:22.669347 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-e2fcba5d-50d6-4853-ab6a-b74ccabe129e tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] [instance: c2b8ba99-d845-4fca-b9e7-fc77ac91a601] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:01:22.680417 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-e2fcba5d-50d6-4853-ab6a-b74ccabe129e tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:22.680876 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-e2fcba5d-50d6-4853-ab6a-b74ccabe129e tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:22.681655 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-e2fcba5d-50d6-4853-ab6a-b74ccabe129e tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:22.682097 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-e2fcba5d-50d6-4853-ab6a-b74ccabe129e tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:22.701217 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-c21e1300-8973-4a85-a449-63622ae8de6e tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:01:22.701868 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-c21e1300-8973-4a85-a449-63622ae8de6e tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] [instance: 5cfd118b-cc42-4dbe-93f1-784454892318] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:01:22.717442 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-c21e1300-8973-4a85-a449-63622ae8de6e tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:22.718063 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-c21e1300-8973-4a85-a449-63622ae8de6e tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:22.719485 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-c21e1300-8973-4a85-a449-63622ae8de6e tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:22.721676 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-c21e1300-8973-4a85-a449-63622ae8de6e tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:23.502693 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-e2fcba5d-50d6-4853-ab6a-b74ccabe129e tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '243e592fbf1844d89f55dd5035a684f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60447df5461141e883d207e028b74bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:23.511585 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-e2fcba5d-50d6-4853-ab6a-b74ccabe129e tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] 10.222.0.17 "GET /compute/v2.1/servers/c2b8ba99-d845-4fca-b9e7-fc77ac91a601" status: 200 len: 1322 microversion: 2.1 time: 0.848498 Jun 16 23:01:23.513252 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 51/100] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:01:22 2022] GET /compute/v2.1/servers/c2b8ba99-d845-4fca-b9e7-fc77ac91a601 => generated 1322 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:01:23.518547 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-9e15f8e0-d2a0-4f8a-9595-7eb130c4d3b8 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:01:23.535486 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-9e15f8e0-d2a0-4f8a-9595-7eb130c4d3b8 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 46f43909-d681-4938-8253-5080b626e169] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:01:23.541552 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-9e15f8e0-d2a0-4f8a-9595-7eb130c4d3b8 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:23.542002 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-9e15f8e0-d2a0-4f8a-9595-7eb130c4d3b8 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:23.542812 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-9e15f8e0-d2a0-4f8a-9595-7eb130c4d3b8 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:23.543251 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-9e15f8e0-d2a0-4f8a-9595-7eb130c4d3b8 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:23.552553 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-c21e1300-8973-4a85-a449-63622ae8de6e tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3a2d16133b4af8a208682de8a7d111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0526c12e8bc947209e24daf5ddfad7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:23.563467 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-c21e1300-8973-4a85-a449-63622ae8de6e tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] 10.222.0.17 "GET /compute/v2.1/servers/5cfd118b-cc42-4dbe-93f1-784454892318" status: 200 len: 1367 microversion: 2.1 time: 0.867916 Jun 16 23:01:23.565667 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 50/101] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:01:22 2022] GET /compute/v2.1/servers/5cfd118b-cc42-4dbe-93f1-784454892318 => generated 1367 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 23:01:23.576162 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-205cff7f-9109-4f1c-af2b-e3279bdeae3d tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:01:23.576774 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-205cff7f-9109-4f1c-af2b-e3279bdeae3d tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] [instance: f4c73822-1dfa-4eed-bf02-1123b0402755] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:01:23.598969 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-205cff7f-9109-4f1c-af2b-e3279bdeae3d tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:23.599961 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-205cff7f-9109-4f1c-af2b-e3279bdeae3d tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:23.601470 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-205cff7f-9109-4f1c-af2b-e3279bdeae3d tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:23.602419 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-205cff7f-9109-4f1c-af2b-e3279bdeae3d tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:24.050547 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-205cff7f-9109-4f1c-af2b-e3279bdeae3d tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a993f5d14b64fccad723abecfcadf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b1be8431b0434d8bd6abca293127d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:24.058747 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-205cff7f-9109-4f1c-af2b-e3279bdeae3d tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] 10.222.0.17 "GET /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755" status: 200 len: 1363 microversion: 2.1 time: 0.491679 Jun 16 23:01:24.059608 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 51/102] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:01:23 2022] GET /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755 => generated 1363 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:01:24.067590 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-9e15f8e0-d2a0-4f8a-9595-7eb130c4d3b8 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:24.077456 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-baff14e9-ce86-444d-b22b-5fce9df416bd tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:01:24.078091 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-baff14e9-ce86-444d-b22b-5fce9df416bd tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] [instance: d40a3e67-031a-4ad7-bd79-7c7d9a3bece9] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:01:24.081564 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-9e15f8e0-d2a0-4f8a-9595-7eb130c4d3b8 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:24.084507 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-9e15f8e0-d2a0-4f8a-9595-7eb130c4d3b8 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:24.085898 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-9e15f8e0-d2a0-4f8a-9595-7eb130c4d3b8 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169" status: 200 len: 1406 microversion: 2.20 time: 0.571546 Jun 16 23:01:24.090401 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 52/103] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 23:01:23 2022] GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169 => generated 1406 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 23:01:24.092482 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-baff14e9-ce86-444d-b22b-5fce9df416bd tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:24.092934 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-baff14e9-ce86-444d-b22b-5fce9df416bd tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:24.093714 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-baff14e9-ce86-444d-b22b-5fce9df416bd tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:24.094182 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-baff14e9-ce86-444d-b22b-5fce9df416bd tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:24.304649 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-baff14e9-ce86-444d-b22b-5fce9df416bd tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a6c4623c5f471b8241257180b64d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2300d78ad8244e3be17c1f388603de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:24.312252 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-baff14e9-ce86-444d-b22b-5fce9df416bd tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] 10.222.0.17 "GET /compute/v2.1/servers/d40a3e67-031a-4ad7-bd79-7c7d9a3bece9" status: 200 len: 1314 microversion: 2.1 time: 0.251407 Jun 16 23:01:24.322873 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 52/104] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:01:24 2022] GET /compute/v2.1/servers/d40a3e67-031a-4ad7-bd79-7c7d9a3bece9 => generated 1314 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:01:24.349753 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [req-8e8f95da-ae97-4953-84de-038065f1253d req-2b37f70e-bb75-4fab-99d8-eb934e0e94d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5cfd118b-cc42-4dbe-93f1-784454892318", "tag": "cdc1a373-1b2c-4326-9d15-b3c2fc92a365"}]} {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 23:01:24.364841 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-8e8f95da-ae97-4953-84de-038065f1253d req-2b37f70e-bb75-4fab-99d8-eb934e0e94d4 service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:24.365285 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-8e8f95da-ae97-4953-84de-038065f1253d req-2b37f70e-bb75-4fab-99d8-eb934e0e94d4 service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:24.395252 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.compute.server_external_events [req-8e8f95da-ae97-4953-84de-038065f1253d req-2b37f70e-bb75-4fab-99d8-eb934e0e94d4 service nova] Creating event network-changed:cdc1a373-1b2c-4326-9d15-b3c2fc92a365 for instance 5cfd118b-cc42-4dbe-93f1-784454892318 on hv-cinder-84623 Jun 16 23:01:24.402369 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [req-8e8f95da-ae97-4953-84de-038065f1253d req-2b37f70e-bb75-4fab-99d8-eb934e0e94d4 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056771 Jun 16 23:01:24.408775 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 53/105] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 23:01:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 23:01:24.531650 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-fc2ae3af-218f-441e-84d8-9f8d35f55f56 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:01:24.533150 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-fc2ae3af-218f-441e-84d8-9f8d35f55f56 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] [instance: c2b8ba99-d845-4fca-b9e7-fc77ac91a601] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:01:24.542704 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-fc2ae3af-218f-441e-84d8-9f8d35f55f56 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:24.543405 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-fc2ae3af-218f-441e-84d8-9f8d35f55f56 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:24.544655 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-fc2ae3af-218f-441e-84d8-9f8d35f55f56 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:24.545318 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-fc2ae3af-218f-441e-84d8-9f8d35f55f56 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:24.581998 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-998ce25c-421a-4156-8bad-5519cdc9d078 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:01:24.582874 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-998ce25c-421a-4156-8bad-5519cdc9d078 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] [instance: 5cfd118b-cc42-4dbe-93f1-784454892318] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:01:24.593648 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-998ce25c-421a-4156-8bad-5519cdc9d078 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:24.594416 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-998ce25c-421a-4156-8bad-5519cdc9d078 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:24.595786 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-998ce25c-421a-4156-8bad-5519cdc9d078 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:24.596439 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-998ce25c-421a-4156-8bad-5519cdc9d078 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:24.815354 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-fc2ae3af-218f-441e-84d8-9f8d35f55f56 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '243e592fbf1844d89f55dd5035a684f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60447df5461141e883d207e028b74bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:24.823564 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-fc2ae3af-218f-441e-84d8-9f8d35f55f56 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] 10.222.0.17 "GET /compute/v2.1/servers/c2b8ba99-d845-4fca-b9e7-fc77ac91a601" status: 200 len: 1322 microversion: 2.1 time: 0.296399 Jun 16 23:01:24.824127 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 53/106] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:01:24 2022] GET /compute/v2.1/servers/c2b8ba99-d845-4fca-b9e7-fc77ac91a601 => generated 1322 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:01:24.827034 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-998ce25c-421a-4156-8bad-5519cdc9d078 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3a2d16133b4af8a208682de8a7d111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0526c12e8bc947209e24daf5ddfad7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:24.828824 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [req-37acdf92-94dd-43ee-9eb1-de3face256d8 req-534e9f9f-d3d6-4921-8ddf-71668b400973 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46f43909-d681-4938-8253-5080b626e169", "tag": "42e82895-598b-468f-aac2-e51ebe9d9946"}]} {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 23:01:24.833891 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG dbcounter [-] [117562] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=117562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 23:01:24.835358 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-998ce25c-421a-4156-8bad-5519cdc9d078 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] 10.222.0.17 "GET /compute/v2.1/servers/5cfd118b-cc42-4dbe-93f1-784454892318" status: 200 len: 1367 microversion: 2.1 time: 0.257823 Jun 16 23:01:24.835925 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 54/107] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:01:24 2022] GET /compute/v2.1/servers/5cfd118b-cc42-4dbe-93f1-784454892318 => generated 1367 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:01:24.838656 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [req-37acdf92-94dd-43ee-9eb1-de3face256d8 req-534e9f9f-d3d6-4921-8ddf-71668b400973 service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:24.839107 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [req-37acdf92-94dd-43ee-9eb1-de3face256d8 req-534e9f9f-d3d6-4921-8ddf-71668b400973 service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:24.850819 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.compute.server_external_events [req-37acdf92-94dd-43ee-9eb1-de3face256d8 req-534e9f9f-d3d6-4921-8ddf-71668b400973 service nova] Creating event network-changed:42e82895-598b-468f-aac2-e51ebe9d9946 for instance 46f43909-d681-4938-8253-5080b626e169 on hv-cinder-84623 Jun 16 23:01:24.855511 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [req-37acdf92-94dd-43ee-9eb1-de3face256d8 req-534e9f9f-d3d6-4921-8ddf-71668b400973 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029929 Jun 16 23:01:24.856096 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 54/108] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 23:01:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 23:01:25.075246 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-f5fc9fa4-2407-407b-ad45-ac0ee0b393ac tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:01:25.075872 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-f5fc9fa4-2407-407b-ad45-ac0ee0b393ac tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] [instance: f4c73822-1dfa-4eed-bf02-1123b0402755] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:01:25.082426 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-f5fc9fa4-2407-407b-ad45-ac0ee0b393ac tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:25.082895 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-f5fc9fa4-2407-407b-ad45-ac0ee0b393ac tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:25.083644 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-f5fc9fa4-2407-407b-ad45-ac0ee0b393ac tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:25.084074 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-f5fc9fa4-2407-407b-ad45-ac0ee0b393ac tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:25.106090 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-b8a9c4bb-b2d7-4f36-9382-62bf4f29949c tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:01:25.107643 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-b8a9c4bb-b2d7-4f36-9382-62bf4f29949c tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 46f43909-d681-4938-8253-5080b626e169] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:01:25.114272 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-b8a9c4bb-b2d7-4f36-9382-62bf4f29949c tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:25.114736 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-b8a9c4bb-b2d7-4f36-9382-62bf4f29949c tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:25.115777 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-b8a9c4bb-b2d7-4f36-9382-62bf4f29949c tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:25.116212 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-b8a9c4bb-b2d7-4f36-9382-62bf4f29949c tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:25.279337 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-f5fc9fa4-2407-407b-ad45-ac0ee0b393ac tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a993f5d14b64fccad723abecfcadf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b1be8431b0434d8bd6abca293127d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:25.283768 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-b8a9c4bb-b2d7-4f36-9382-62bf4f29949c tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:25.287135 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-f5fc9fa4-2407-407b-ad45-ac0ee0b393ac tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] 10.222.0.17 "GET /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755" status: 200 len: 1363 microversion: 2.1 time: 0.215683 Jun 16 23:01:25.287729 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 55/109] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:01:25 2022] GET /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755 => generated 1363 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:01:25.291794 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-b8a9c4bb-b2d7-4f36-9382-62bf4f29949c tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:25.293284 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-b8a9c4bb-b2d7-4f36-9382-62bf4f29949c tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:25.294403 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-b8a9c4bb-b2d7-4f36-9382-62bf4f29949c tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169" status: 200 len: 1406 microversion: 2.20 time: 0.193015 Jun 16 23:01:25.294971 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 55/110] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 23:01:25 2022] GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169 => generated 1406 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 23:01:25.328818 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-040f2f3a-020a-4dd1-ad2c-53f5fcb53c99 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:01:25.329517 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-040f2f3a-020a-4dd1-ad2c-53f5fcb53c99 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] [instance: d40a3e67-031a-4ad7-bd79-7c7d9a3bece9] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:01:25.335496 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-040f2f3a-020a-4dd1-ad2c-53f5fcb53c99 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:25.335944 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-040f2f3a-020a-4dd1-ad2c-53f5fcb53c99 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:25.336697 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-040f2f3a-020a-4dd1-ad2c-53f5fcb53c99 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:25.337128 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-040f2f3a-020a-4dd1-ad2c-53f5fcb53c99 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:25.341023 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG dbcounter [-] [117563] Writing DB stats nova_cell1:SELECT=100 {{(pid=117563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 23:01:25.466026 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-040f2f3a-020a-4dd1-ad2c-53f5fcb53c99 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a6c4623c5f471b8241257180b64d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2300d78ad8244e3be17c1f388603de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:25.473849 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-040f2f3a-020a-4dd1-ad2c-53f5fcb53c99 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] 10.222.0.17 "GET /compute/v2.1/servers/d40a3e67-031a-4ad7-bd79-7c7d9a3bece9" status: 200 len: 1314 microversion: 2.1 time: 0.148722 Jun 16 23:01:25.474401 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 56/111] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:01:25 2022] GET /compute/v2.1/servers/d40a3e67-031a-4ad7-bd79-7c7d9a3bece9 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:01:25.840482 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-b0efc4b6-b7b0-42df-aca1-e3fe2200eb1d tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:01:25.841115 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-b0efc4b6-b7b0-42df-aca1-e3fe2200eb1d tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] [instance: c2b8ba99-d845-4fca-b9e7-fc77ac91a601] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:01:25.847214 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-b0efc4b6-b7b0-42df-aca1-e3fe2200eb1d tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:25.847669 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-b0efc4b6-b7b0-42df-aca1-e3fe2200eb1d tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:25.848440 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-b0efc4b6-b7b0-42df-aca1-e3fe2200eb1d tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:25.848879 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-b0efc4b6-b7b0-42df-aca1-e3fe2200eb1d tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:25.852410 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-920d73b2-2a87-4001-9d2c-aa5bbdd7392a tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:01:25.853054 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-920d73b2-2a87-4001-9d2c-aa5bbdd7392a tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] [instance: 5cfd118b-cc42-4dbe-93f1-784454892318] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:01:25.859337 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-920d73b2-2a87-4001-9d2c-aa5bbdd7392a tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:25.859785 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-920d73b2-2a87-4001-9d2c-aa5bbdd7392a tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:25.860597 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-920d73b2-2a87-4001-9d2c-aa5bbdd7392a tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:25.861037 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-920d73b2-2a87-4001-9d2c-aa5bbdd7392a tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:26.044593 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-b0efc4b6-b7b0-42df-aca1-e3fe2200eb1d tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '243e592fbf1844d89f55dd5035a684f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60447df5461141e883d207e028b74bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:26.048267 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-920d73b2-2a87-4001-9d2c-aa5bbdd7392a tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3a2d16133b4af8a208682de8a7d111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0526c12e8bc947209e24daf5ddfad7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:26.054032 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-b0efc4b6-b7b0-42df-aca1-e3fe2200eb1d tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] 10.222.0.17 "GET /compute/v2.1/servers/c2b8ba99-d845-4fca-b9e7-fc77ac91a601" status: 200 len: 1322 microversion: 2.1 time: 0.217335 Jun 16 23:01:26.054639 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 56/112] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:01:25 2022] GET /compute/v2.1/servers/c2b8ba99-d845-4fca-b9e7-fc77ac91a601 => generated 1322 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:01:26.057943 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-920d73b2-2a87-4001-9d2c-aa5bbdd7392a tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] 10.222.0.17 "GET /compute/v2.1/servers/5cfd118b-cc42-4dbe-93f1-784454892318" status: 200 len: 1367 microversion: 2.1 time: 0.209623 Jun 16 23:01:26.063152 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 57/113] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:01:25 2022] GET /compute/v2.1/servers/5cfd118b-cc42-4dbe-93f1-784454892318 => generated 1367 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 23:01:26.304728 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-8d265552-856b-432c-b57a-14a46599db2a tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:01:26.305272 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-8d265552-856b-432c-b57a-14a46599db2a tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] [instance: f4c73822-1dfa-4eed-bf02-1123b0402755] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:01:26.311720 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-8d265552-856b-432c-b57a-14a46599db2a tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:26.312168 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-8d265552-856b-432c-b57a-14a46599db2a tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:26.312493 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-56c1a0c6-7c43-45e8-8a4c-4fbd5f29b61e tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:01:26.312933 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-8d265552-856b-432c-b57a-14a46599db2a tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:26.313094 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-56c1a0c6-7c43-45e8-8a4c-4fbd5f29b61e tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 46f43909-d681-4938-8253-5080b626e169] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:01:26.313368 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-8d265552-856b-432c-b57a-14a46599db2a tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:26.319615 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-56c1a0c6-7c43-45e8-8a4c-4fbd5f29b61e tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:26.320056 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-56c1a0c6-7c43-45e8-8a4c-4fbd5f29b61e tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:26.320809 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-56c1a0c6-7c43-45e8-8a4c-4fbd5f29b61e tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:26.321241 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-56c1a0c6-7c43-45e8-8a4c-4fbd5f29b61e tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:26.507363 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-8d265552-856b-432c-b57a-14a46599db2a tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a993f5d14b64fccad723abecfcadf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b1be8431b0434d8bd6abca293127d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:26.512518 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-56c1a0c6-7c43-45e8-8a4c-4fbd5f29b61e tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:26.514782 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-8d265552-856b-432c-b57a-14a46599db2a tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] 10.222.0.17 "GET /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755" status: 200 len: 1363 microversion: 2.1 time: 0.213849 Jun 16 23:01:26.515366 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 57/114] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:01:26 2022] GET /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755 => generated 1363 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:01:26.519782 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-d1e15d09-816d-4b90-ad16-e3b2b317ad88 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:01:26.520593 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-d1e15d09-816d-4b90-ad16-e3b2b317ad88 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] [instance: d40a3e67-031a-4ad7-bd79-7c7d9a3bece9] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:01:26.524631 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-56c1a0c6-7c43-45e8-8a4c-4fbd5f29b61e tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:26.526690 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-d1e15d09-816d-4b90-ad16-e3b2b317ad88 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:26.526820 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-56c1a0c6-7c43-45e8-8a4c-4fbd5f29b61e tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:26.527440 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-d1e15d09-816d-4b90-ad16-e3b2b317ad88 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:26.528012 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-56c1a0c6-7c43-45e8-8a4c-4fbd5f29b61e tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169" status: 200 len: 1406 microversion: 2.20 time: 0.219432 Jun 16 23:01:26.528206 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-d1e15d09-816d-4b90-ad16-e3b2b317ad88 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:26.528624 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 58/115] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 23:01:26 2022] GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169 => generated 1406 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 23:01:26.528990 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-d1e15d09-816d-4b90-ad16-e3b2b317ad88 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:26.549252 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG dbcounter [-] [117562] Writing DB stats nova_cell1:SELECT=100 {{(pid=117562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 23:01:26.597307 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [req-fdef21a5-d9f2-447b-a1e4-84c27afe14d1 req-8117abdb-a8ef-42a3-9339-4ef8df502534 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ad3ba60-bc63-4d0a-be00-f9b00e66d803", "name": "network-vif-plugged", "status": "completed", "tag": "27dc1467-d62f-4447-a2e6-d4697ce9cdfa"}]} {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 23:01:26.606487 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-fdef21a5-d9f2-447b-a1e4-84c27afe14d1 req-8117abdb-a8ef-42a3-9339-4ef8df502534 service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:26.607086 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-fdef21a5-d9f2-447b-a1e4-84c27afe14d1 req-8117abdb-a8ef-42a3-9339-4ef8df502534 service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:26.621399 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.compute.server_external_events [req-fdef21a5-d9f2-447b-a1e4-84c27afe14d1 req-8117abdb-a8ef-42a3-9339-4ef8df502534 service nova] Creating event network-vif-plugged:27dc1467-d62f-4447-a2e6-d4697ce9cdfa for instance 4ad3ba60-bc63-4d0a-be00-f9b00e66d803 on hv-cinder-84623 Jun 16 23:01:26.639944 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [req-fdef21a5-d9f2-447b-a1e4-84c27afe14d1 req-8117abdb-a8ef-42a3-9339-4ef8df502534 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045866 Jun 16 23:01:26.641574 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 59/116] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 23:01:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 23:01:26.706042 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-d1e15d09-816d-4b90-ad16-e3b2b317ad88 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a6c4623c5f471b8241257180b64d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2300d78ad8244e3be17c1f388603de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:26.713823 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-d1e15d09-816d-4b90-ad16-e3b2b317ad88 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] 10.222.0.17 "GET /compute/v2.1/servers/d40a3e67-031a-4ad7-bd79-7c7d9a3bece9" status: 200 len: 1314 microversion: 2.1 time: 0.197472 Jun 16 23:01:26.714383 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 58/117] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:01:26 2022] GET /compute/v2.1/servers/d40a3e67-031a-4ad7-bd79-7c7d9a3bece9 => generated 1314 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:01:27.071854 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-04fad453-bab9-402c-894c-02303c338fa8 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:01:27.074108 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-04fad453-bab9-402c-894c-02303c338fa8 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] [instance: c2b8ba99-d845-4fca-b9e7-fc77ac91a601] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:01:27.074693 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-7acf09a1-3813-434f-af0e-c6c78e72bb88 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:01:27.083036 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-7acf09a1-3813-434f-af0e-c6c78e72bb88 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] [instance: 5cfd118b-cc42-4dbe-93f1-784454892318] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:01:27.083820 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-04fad453-bab9-402c-894c-02303c338fa8 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:27.084424 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-04fad453-bab9-402c-894c-02303c338fa8 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:27.085341 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-04fad453-bab9-402c-894c-02303c338fa8 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:27.086329 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-04fad453-bab9-402c-894c-02303c338fa8 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:27.089965 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-7acf09a1-3813-434f-af0e-c6c78e72bb88 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:27.092044 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-7acf09a1-3813-434f-af0e-c6c78e72bb88 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:27.093247 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-7acf09a1-3813-434f-af0e-c6c78e72bb88 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:27.093964 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-7acf09a1-3813-434f-af0e-c6c78e72bb88 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:27.285902 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-04fad453-bab9-402c-894c-02303c338fa8 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '243e592fbf1844d89f55dd5035a684f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60447df5461141e883d207e028b74bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:27.292944 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-7acf09a1-3813-434f-af0e-c6c78e72bb88 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3a2d16133b4af8a208682de8a7d111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0526c12e8bc947209e24daf5ddfad7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:27.293228 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-04fad453-bab9-402c-894c-02303c338fa8 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] 10.222.0.17 "GET /compute/v2.1/servers/c2b8ba99-d845-4fca-b9e7-fc77ac91a601" status: 200 len: 1322 microversion: 2.1 time: 0.225810 Jun 16 23:01:27.293800 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 60/118] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:01:27 2022] GET /compute/v2.1/servers/c2b8ba99-d845-4fca-b9e7-fc77ac91a601 => generated 1322 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:01:27.300796 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-7acf09a1-3813-434f-af0e-c6c78e72bb88 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] 10.222.0.17 "GET /compute/v2.1/servers/5cfd118b-cc42-4dbe-93f1-784454892318" status: 200 len: 1367 microversion: 2.1 time: 0.230074 Jun 16 23:01:27.301432 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 59/119] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:01:27 2022] GET /compute/v2.1/servers/5cfd118b-cc42-4dbe-93f1-784454892318 => generated 1367 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 23:01:27.531380 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-e1a5b440-e417-4ea6-88de-56ae2b0ab9b8 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:01:27.531985 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-e1a5b440-e417-4ea6-88de-56ae2b0ab9b8 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] [instance: f4c73822-1dfa-4eed-bf02-1123b0402755] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:01:27.538452 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-e1a5b440-e417-4ea6-88de-56ae2b0ab9b8 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:27.538940 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-e1a5b440-e417-4ea6-88de-56ae2b0ab9b8 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:27.539709 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-e1a5b440-e417-4ea6-88de-56ae2b0ab9b8 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:27.540150 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-e1a5b440-e417-4ea6-88de-56ae2b0ab9b8 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:27.545972 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-0743fac9-dbc2-4c73-ac9e-9a0abbf2ae38 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:01:27.546583 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-0743fac9-dbc2-4c73-ac9e-9a0abbf2ae38 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 46f43909-d681-4938-8253-5080b626e169] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:01:27.553100 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-0743fac9-dbc2-4c73-ac9e-9a0abbf2ae38 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:27.553552 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-0743fac9-dbc2-4c73-ac9e-9a0abbf2ae38 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:27.554321 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-0743fac9-dbc2-4c73-ac9e-9a0abbf2ae38 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:27.554794 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-0743fac9-dbc2-4c73-ac9e-9a0abbf2ae38 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:27.739080 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-e1a5b440-e417-4ea6-88de-56ae2b0ab9b8 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a993f5d14b64fccad723abecfcadf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b1be8431b0434d8bd6abca293127d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:27.743380 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-0743fac9-dbc2-4c73-ac9e-9a0abbf2ae38 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:27.746803 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-e1a5b440-e417-4ea6-88de-56ae2b0ab9b8 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] 10.222.0.17 "GET /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755" status: 200 len: 1363 microversion: 2.1 time: 0.219111 Jun 16 23:01:27.747386 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 61/120] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:01:27 2022] GET /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755 => generated 1363 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:01:27.751925 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-0743fac9-dbc2-4c73-ac9e-9a0abbf2ae38 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:27.752085 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-85fce591-c5be-4f25-9fff-1952e71f3189 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:01:27.752548 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-85fce591-c5be-4f25-9fff-1952e71f3189 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] [instance: d40a3e67-031a-4ad7-bd79-7c7d9a3bece9] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:01:27.753785 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-0743fac9-dbc2-4c73-ac9e-9a0abbf2ae38 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:27.755218 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-0743fac9-dbc2-4c73-ac9e-9a0abbf2ae38 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169" status: 200 len: 1406 microversion: 2.20 time: 0.213124 Jun 16 23:01:27.756003 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 60/121] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 23:01:27 2022] GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169 => generated 1406 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 23:01:27.758418 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-85fce591-c5be-4f25-9fff-1952e71f3189 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:27.758902 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-85fce591-c5be-4f25-9fff-1952e71f3189 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:27.759667 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-85fce591-c5be-4f25-9fff-1952e71f3189 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:27.760146 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-85fce591-c5be-4f25-9fff-1952e71f3189 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:27.884736 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-85fce591-c5be-4f25-9fff-1952e71f3189 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a6c4623c5f471b8241257180b64d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2300d78ad8244e3be17c1f388603de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:27.892586 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-85fce591-c5be-4f25-9fff-1952e71f3189 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] 10.222.0.17 "GET /compute/v2.1/servers/d40a3e67-031a-4ad7-bd79-7c7d9a3bece9" status: 200 len: 1314 microversion: 2.1 time: 0.144248 Jun 16 23:01:27.893151 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 62/122] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:01:27 2022] GET /compute/v2.1/servers/d40a3e67-031a-4ad7-bd79-7c7d9a3bece9 => generated 1314 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:01:28.309106 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-f6aff16e-2c2c-4039-8bc0-e6fcfd658788 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:01:28.309709 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-f6aff16e-2c2c-4039-8bc0-e6fcfd658788 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] [instance: c2b8ba99-d845-4fca-b9e7-fc77ac91a601] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:01:28.315833 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-f6aff16e-2c2c-4039-8bc0-e6fcfd658788 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:28.316283 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-f6aff16e-2c2c-4039-8bc0-e6fcfd658788 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:28.317108 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-00079e0c-a664-4b7f-b201-340e42e6a3f0 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:01:28.317519 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-f6aff16e-2c2c-4039-8bc0-e6fcfd658788 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:28.317616 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-f6aff16e-2c2c-4039-8bc0-e6fcfd658788 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:28.317707 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-00079e0c-a664-4b7f-b201-340e42e6a3f0 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] [instance: 5cfd118b-cc42-4dbe-93f1-784454892318] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:01:28.323652 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-00079e0c-a664-4b7f-b201-340e42e6a3f0 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:28.324094 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-00079e0c-a664-4b7f-b201-340e42e6a3f0 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:28.324842 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-00079e0c-a664-4b7f-b201-340e42e6a3f0 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:28.325274 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-00079e0c-a664-4b7f-b201-340e42e6a3f0 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:28.509826 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-f6aff16e-2c2c-4039-8bc0-e6fcfd658788 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '243e592fbf1844d89f55dd5035a684f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60447df5461141e883d207e028b74bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:28.512998 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-00079e0c-a664-4b7f-b201-340e42e6a3f0 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3a2d16133b4af8a208682de8a7d111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0526c12e8bc947209e24daf5ddfad7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:28.517232 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-f6aff16e-2c2c-4039-8bc0-e6fcfd658788 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] 10.222.0.17 "GET /compute/v2.1/servers/c2b8ba99-d845-4fca-b9e7-fc77ac91a601" status: 200 len: 1322 microversion: 2.1 time: 0.211885 Jun 16 23:01:28.518111 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 61/123] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:01:28 2022] GET /compute/v2.1/servers/c2b8ba99-d845-4fca-b9e7-fc77ac91a601 => generated 1322 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:01:28.520703 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-00079e0c-a664-4b7f-b201-340e42e6a3f0 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] 10.222.0.17 "GET /compute/v2.1/servers/5cfd118b-cc42-4dbe-93f1-784454892318" status: 200 len: 1367 microversion: 2.1 time: 0.207386 Jun 16 23:01:28.521434 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 63/124] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:01:28 2022] GET /compute/v2.1/servers/5cfd118b-cc42-4dbe-93f1-784454892318 => generated 1367 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 23:01:28.763519 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-ba98bacb-4c18-440b-a691-888edb565b6d tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:01:28.764055 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-ba98bacb-4c18-440b-a691-888edb565b6d tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] [instance: f4c73822-1dfa-4eed-bf02-1123b0402755] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:01:28.770578 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-ba98bacb-4c18-440b-a691-888edb565b6d tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:28.771058 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-ba98bacb-4c18-440b-a691-888edb565b6d tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:28.771815 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-ba98bacb-4c18-440b-a691-888edb565b6d tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:28.772251 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-ba98bacb-4c18-440b-a691-888edb565b6d tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:28.773352 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-ed9b3a2b-f90b-4bcf-9e70-ef0f0b288b99 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:01:28.773950 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-ed9b3a2b-f90b-4bcf-9e70-ef0f0b288b99 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 46f43909-d681-4938-8253-5080b626e169] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:01:28.779952 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-ed9b3a2b-f90b-4bcf-9e70-ef0f0b288b99 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:28.780402 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-ed9b3a2b-f90b-4bcf-9e70-ef0f0b288b99 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:28.781153 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-ed9b3a2b-f90b-4bcf-9e70-ef0f0b288b99 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:28.781585 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-ed9b3a2b-f90b-4bcf-9e70-ef0f0b288b99 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:28.965596 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-ba98bacb-4c18-440b-a691-888edb565b6d tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a993f5d14b64fccad723abecfcadf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b1be8431b0434d8bd6abca293127d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:28.969581 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-ed9b3a2b-f90b-4bcf-9e70-ef0f0b288b99 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:28.974466 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-ba98bacb-4c18-440b-a691-888edb565b6d tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] 10.222.0.17 "GET /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755" status: 200 len: 1363 microversion: 2.1 time: 0.214778 Jun 16 23:01:28.975193 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 62/125] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:01:28 2022] GET /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755 => generated 1363 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:01:28.979619 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-236b47f2-e33c-4fcd-ac47-adff0c1416a5 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:01:28.980217 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-236b47f2-e33c-4fcd-ac47-adff0c1416a5 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] [instance: d40a3e67-031a-4ad7-bd79-7c7d9a3bece9] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:01:28.980383 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-ed9b3a2b-f90b-4bcf-9e70-ef0f0b288b99 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:28.983761 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-ed9b3a2b-f90b-4bcf-9e70-ef0f0b288b99 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:28.986520 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-ed9b3a2b-f90b-4bcf-9e70-ef0f0b288b99 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169" status: 200 len: 1406 microversion: 2.20 time: 0.216622 Jun 16 23:01:28.987825 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 64/126] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 23:01:28 2022] GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169 => generated 1406 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 23:01:28.987989 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-236b47f2-e33c-4fcd-ac47-adff0c1416a5 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:28.988285 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-236b47f2-e33c-4fcd-ac47-adff0c1416a5 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:28.989055 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-236b47f2-e33c-4fcd-ac47-adff0c1416a5 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:28.989489 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-236b47f2-e33c-4fcd-ac47-adff0c1416a5 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:29.117486 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-236b47f2-e33c-4fcd-ac47-adff0c1416a5 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a6c4623c5f471b8241257180b64d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2300d78ad8244e3be17c1f388603de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:29.124854 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-236b47f2-e33c-4fcd-ac47-adff0c1416a5 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] 10.222.0.17 "GET /compute/v2.1/servers/d40a3e67-031a-4ad7-bd79-7c7d9a3bece9" status: 200 len: 1314 microversion: 2.1 time: 0.148718 Jun 16 23:01:29.125415 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 63/127] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:01:28 2022] GET /compute/v2.1/servers/d40a3e67-031a-4ad7-bd79-7c7d9a3bece9 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:01:29.534560 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-f56407e3-dc22-4d05-adad-907a2588fb46 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:01:29.535186 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-f56407e3-dc22-4d05-adad-907a2588fb46 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] [instance: c2b8ba99-d845-4fca-b9e7-fc77ac91a601] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:01:29.537422 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-8c5cc4f9-2974-4026-9a1c-a3c65d76d8e6 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:01:29.538026 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-8c5cc4f9-2974-4026-9a1c-a3c65d76d8e6 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] [instance: 5cfd118b-cc42-4dbe-93f1-784454892318] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:01:29.541118 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-f56407e3-dc22-4d05-adad-907a2588fb46 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:29.541574 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-f56407e3-dc22-4d05-adad-907a2588fb46 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:29.542328 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-f56407e3-dc22-4d05-adad-907a2588fb46 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:29.542796 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-f56407e3-dc22-4d05-adad-907a2588fb46 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:29.544322 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-8c5cc4f9-2974-4026-9a1c-a3c65d76d8e6 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:29.544772 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-8c5cc4f9-2974-4026-9a1c-a3c65d76d8e6 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:29.545533 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-8c5cc4f9-2974-4026-9a1c-a3c65d76d8e6 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:29.545965 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-8c5cc4f9-2974-4026-9a1c-a3c65d76d8e6 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:29.736955 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-f56407e3-dc22-4d05-adad-907a2588fb46 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '243e592fbf1844d89f55dd5035a684f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60447df5461141e883d207e028b74bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:29.741226 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-8c5cc4f9-2974-4026-9a1c-a3c65d76d8e6 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3a2d16133b4af8a208682de8a7d111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0526c12e8bc947209e24daf5ddfad7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:29.745091 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-f56407e3-dc22-4d05-adad-907a2588fb46 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] 10.222.0.17 "GET /compute/v2.1/servers/c2b8ba99-d845-4fca-b9e7-fc77ac91a601" status: 200 len: 1322 microversion: 2.1 time: 0.214767 Jun 16 23:01:29.745669 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 65/128] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:01:29 2022] GET /compute/v2.1/servers/c2b8ba99-d845-4fca-b9e7-fc77ac91a601 => generated 1322 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:01:29.749847 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-8c5cc4f9-2974-4026-9a1c-a3c65d76d8e6 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] 10.222.0.17 "GET /compute/v2.1/servers/5cfd118b-cc42-4dbe-93f1-784454892318" status: 200 len: 1367 microversion: 2.1 time: 0.216112 Jun 16 23:01:29.750396 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 64/129] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:01:29 2022] GET /compute/v2.1/servers/5cfd118b-cc42-4dbe-93f1-784454892318 => generated 1367 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 23:01:30.001681 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-a9418637-392e-42ee-80eb-cd06339bfa64 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:01:30.002206 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-a9418637-392e-42ee-80eb-cd06339bfa64 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] [instance: f4c73822-1dfa-4eed-bf02-1123b0402755] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:01:30.005533 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-de701fae-87e1-4bb2-9fe8-7c8a812e57fa tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:01:30.006197 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-de701fae-87e1-4bb2-9fe8-7c8a812e57fa tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 46f43909-d681-4938-8253-5080b626e169] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:01:30.008989 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-a9418637-392e-42ee-80eb-cd06339bfa64 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:30.009228 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-a9418637-392e-42ee-80eb-cd06339bfa64 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:30.010001 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-a9418637-392e-42ee-80eb-cd06339bfa64 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:30.010440 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-a9418637-392e-42ee-80eb-cd06339bfa64 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:30.012078 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-de701fae-87e1-4bb2-9fe8-7c8a812e57fa tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:30.012532 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-de701fae-87e1-4bb2-9fe8-7c8a812e57fa tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:30.013479 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-de701fae-87e1-4bb2-9fe8-7c8a812e57fa tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:30.013939 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-de701fae-87e1-4bb2-9fe8-7c8a812e57fa tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:30.216666 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-a9418637-392e-42ee-80eb-cd06339bfa64 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a993f5d14b64fccad723abecfcadf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b1be8431b0434d8bd6abca293127d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:30.223132 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-de701fae-87e1-4bb2-9fe8-7c8a812e57fa tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:30.224723 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-a9418637-392e-42ee-80eb-cd06339bfa64 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] 10.222.0.17 "GET /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755" status: 200 len: 1363 microversion: 2.1 time: 0.227757 Jun 16 23:01:30.226928 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 66/130] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:01:29 2022] GET /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755 => generated 1363 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:01:30.233147 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-de701fae-87e1-4bb2-9fe8-7c8a812e57fa tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:30.234665 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-de701fae-87e1-4bb2-9fe8-7c8a812e57fa tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:30.236442 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-de701fae-87e1-4bb2-9fe8-7c8a812e57fa tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169" status: 200 len: 1406 microversion: 2.20 time: 0.235143 Jun 16 23:01:30.245700 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 65/131] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 23:01:30 2022] GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169 => generated 1406 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 23:01:30.245700 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-b77405c6-6505-4da4-9b16-75b6e1611f0c tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:01:30.247019 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [req-f5960732-9eba-4891-852b-18429b5da2d2 req-7934f908-15c2-4c7a-860e-9373ed04bf93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2b8ba99-d845-4fca-b9e7-fc77ac91a601", "name": "network-vif-plugged", "status": "completed", "tag": "020e6819-d071-41f2-9573-ea592ee5004c"}]} {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 23:01:30.247121 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-b77405c6-6505-4da4-9b16-75b6e1611f0c tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] [instance: d40a3e67-031a-4ad7-bd79-7c7d9a3bece9] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:01:30.251801 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-b77405c6-6505-4da4-9b16-75b6e1611f0c tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:30.252187 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-b77405c6-6505-4da4-9b16-75b6e1611f0c tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:30.252529 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-f5960732-9eba-4891-852b-18429b5da2d2 req-7934f908-15c2-4c7a-860e-9373ed04bf93 service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:30.252946 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-b77405c6-6505-4da4-9b16-75b6e1611f0c tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:30.253043 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-f5960732-9eba-4891-852b-18429b5da2d2 req-7934f908-15c2-4c7a-860e-9373ed04bf93 service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:30.253376 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-b77405c6-6505-4da4-9b16-75b6e1611f0c tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:30.265586 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.compute.server_external_events [req-f5960732-9eba-4891-852b-18429b5da2d2 req-7934f908-15c2-4c7a-860e-9373ed04bf93 service nova] Creating event network-vif-plugged:020e6819-d071-41f2-9573-ea592ee5004c for instance c2b8ba99-d845-4fca-b9e7-fc77ac91a601 on hv-cinder-84623 Jun 16 23:01:30.270484 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [req-f5960732-9eba-4891-852b-18429b5da2d2 req-7934f908-15c2-4c7a-860e-9373ed04bf93 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041672 Jun 16 23:01:30.271178 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 67/132] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 23:01:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 23:01:30.763560 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-b77405c6-6505-4da4-9b16-75b6e1611f0c tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a6c4623c5f471b8241257180b64d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2300d78ad8244e3be17c1f388603de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:30.764338 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-83b28de6-699a-4316-9cc9-1c42e9c4b65c tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:01:30.765677 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-83b28de6-699a-4316-9cc9-1c42e9c4b65c tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] [instance: c2b8ba99-d845-4fca-b9e7-fc77ac91a601] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:01:30.779046 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-b77405c6-6505-4da4-9b16-75b6e1611f0c tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] 10.222.0.17 "GET /compute/v2.1/servers/d40a3e67-031a-4ad7-bd79-7c7d9a3bece9" status: 200 len: 1314 microversion: 2.1 time: 0.540305 Jun 16 23:01:30.779653 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-83b28de6-699a-4316-9cc9-1c42e9c4b65c tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:30.780317 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 66/133] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:01:30 2022] GET /compute/v2.1/servers/d40a3e67-031a-4ad7-bd79-7c7d9a3bece9 => generated 1314 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:01:30.787531 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-bc5226e5-d571-4fe6-9115-5a574d308359 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:01:30.788338 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-bc5226e5-d571-4fe6-9115-5a574d308359 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] [instance: 5cfd118b-cc42-4dbe-93f1-784454892318] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:01:30.789546 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-83b28de6-699a-4316-9cc9-1c42e9c4b65c tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:30.792272 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-83b28de6-699a-4316-9cc9-1c42e9c4b65c tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:30.793946 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-83b28de6-699a-4316-9cc9-1c42e9c4b65c tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:30.797636 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-bc5226e5-d571-4fe6-9115-5a574d308359 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:30.798301 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-bc5226e5-d571-4fe6-9115-5a574d308359 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:30.799248 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-bc5226e5-d571-4fe6-9115-5a574d308359 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:30.799838 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-bc5226e5-d571-4fe6-9115-5a574d308359 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:31.095012 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-bc5226e5-d571-4fe6-9115-5a574d308359 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3a2d16133b4af8a208682de8a7d111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0526c12e8bc947209e24daf5ddfad7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:31.102006 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-83b28de6-699a-4316-9cc9-1c42e9c4b65c tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '243e592fbf1844d89f55dd5035a684f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60447df5461141e883d207e028b74bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:31.103329 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-bc5226e5-d571-4fe6-9115-5a574d308359 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] 10.222.0.17 "GET /compute/v2.1/servers/5cfd118b-cc42-4dbe-93f1-784454892318" status: 200 len: 1367 microversion: 2.1 time: 0.321868 Jun 16 23:01:31.103893 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 67/134] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:01:30 2022] GET /compute/v2.1/servers/5cfd118b-cc42-4dbe-93f1-784454892318 => generated 1367 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:01:31.109754 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-83b28de6-699a-4316-9cc9-1c42e9c4b65c tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] 10.222.0.17 "GET /compute/v2.1/servers/c2b8ba99-d845-4fca-b9e7-fc77ac91a601" status: 200 len: 1322 microversion: 2.1 time: 0.351912 Jun 16 23:01:31.112227 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 68/135] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:01:30 2022] GET /compute/v2.1/servers/c2b8ba99-d845-4fca-b9e7-fc77ac91a601 => generated 1322 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:01:31.241729 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-5ff35d4b-72c8-464c-9c10-2e51d84c46de tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:01:31.242337 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-5ff35d4b-72c8-464c-9c10-2e51d84c46de tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] [instance: f4c73822-1dfa-4eed-bf02-1123b0402755] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:01:31.248311 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-5ff35d4b-72c8-464c-9c10-2e51d84c46de tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:31.248757 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-5ff35d4b-72c8-464c-9c10-2e51d84c46de tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:31.249513 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-5ff35d4b-72c8-464c-9c10-2e51d84c46de tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:31.249946 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-5ff35d4b-72c8-464c-9c10-2e51d84c46de tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:31.255767 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-d84e0853-9ad1-4aac-8a03-e850f79ece0d tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:01:31.256452 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-d84e0853-9ad1-4aac-8a03-e850f79ece0d tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 46f43909-d681-4938-8253-5080b626e169] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:01:31.262825 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-d84e0853-9ad1-4aac-8a03-e850f79ece0d tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:31.263271 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-d84e0853-9ad1-4aac-8a03-e850f79ece0d tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:31.264026 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-d84e0853-9ad1-4aac-8a03-e850f79ece0d tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:31.264463 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-d84e0853-9ad1-4aac-8a03-e850f79ece0d tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:31.440321 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-5ff35d4b-72c8-464c-9c10-2e51d84c46de tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a993f5d14b64fccad723abecfcadf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b1be8431b0434d8bd6abca293127d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:31.447717 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-5ff35d4b-72c8-464c-9c10-2e51d84c46de tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] 10.222.0.17 "GET /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755" status: 200 len: 1363 microversion: 2.1 time: 0.209772 Jun 16 23:01:31.448574 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 68/136] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:01:31 2022] GET /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755 => generated 1363 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:01:31.450988 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-d84e0853-9ad1-4aac-8a03-e850f79ece0d tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:31.459348 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-d84e0853-9ad1-4aac-8a03-e850f79ece0d tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:31.460861 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-d84e0853-9ad1-4aac-8a03-e850f79ece0d tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:31.461952 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-d84e0853-9ad1-4aac-8a03-e850f79ece0d tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169" status: 200 len: 1406 microversion: 2.20 time: 0.209971 Jun 16 23:01:31.462500 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 69/137] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 23:01:31 2022] GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169 => generated 1406 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 23:01:31.798142 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-3aca9f92-94f2-45ac-9e6b-32d9a9323d02 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:01:31.799363 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-3aca9f92-94f2-45ac-9e6b-32d9a9323d02 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] [instance: d40a3e67-031a-4ad7-bd79-7c7d9a3bece9] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:01:31.809053 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-3aca9f92-94f2-45ac-9e6b-32d9a9323d02 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:31.810153 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-3aca9f92-94f2-45ac-9e6b-32d9a9323d02 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:31.811902 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-3aca9f92-94f2-45ac-9e6b-32d9a9323d02 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:31.812825 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-3aca9f92-94f2-45ac-9e6b-32d9a9323d02 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:31.988188 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-3aca9f92-94f2-45ac-9e6b-32d9a9323d02 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a6c4623c5f471b8241257180b64d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2300d78ad8244e3be17c1f388603de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:31.997785 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-3aca9f92-94f2-45ac-9e6b-32d9a9323d02 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] 10.222.0.17 "GET /compute/v2.1/servers/d40a3e67-031a-4ad7-bd79-7c7d9a3bece9" status: 200 len: 1499 microversion: 2.1 time: 0.204964 Jun 16 23:01:31.998356 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 69/138] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:01:31 2022] GET /compute/v2.1/servers/d40a3e67-031a-4ad7-bd79-7c7d9a3bece9 => generated 1499 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:01:32.121366 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-c6154b50-8670-4dd6-9ef1-f3d886529394 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:01:32.122052 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-c6154b50-8670-4dd6-9ef1-f3d886529394 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] [instance: 5cfd118b-cc42-4dbe-93f1-784454892318] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:01:32.127243 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-faece31e-dbf5-42f3-9e2f-61b93b8e633d tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:01:32.128312 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-faece31e-dbf5-42f3-9e2f-61b93b8e633d tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] [instance: c2b8ba99-d845-4fca-b9e7-fc77ac91a601] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:01:32.137470 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-faece31e-dbf5-42f3-9e2f-61b93b8e633d tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:32.138986 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-faece31e-dbf5-42f3-9e2f-61b93b8e633d tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:32.139936 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-c6154b50-8670-4dd6-9ef1-f3d886529394 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:32.140639 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-c6154b50-8670-4dd6-9ef1-f3d886529394 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:32.142241 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-c6154b50-8670-4dd6-9ef1-f3d886529394 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:32.143098 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-faece31e-dbf5-42f3-9e2f-61b93b8e633d tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:32.143619 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-faece31e-dbf5-42f3-9e2f-61b93b8e633d tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:32.144830 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-c6154b50-8670-4dd6-9ef1-f3d886529394 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:32.443004 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-c6154b50-8670-4dd6-9ef1-f3d886529394 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3a2d16133b4af8a208682de8a7d111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0526c12e8bc947209e24daf5ddfad7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:32.456853 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-c6154b50-8670-4dd6-9ef1-f3d886529394 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] 10.222.0.17 "GET /compute/v2.1/servers/5cfd118b-cc42-4dbe-93f1-784454892318" status: 200 len: 1367 microversion: 2.1 time: 0.339347 Jun 16 23:01:32.462192 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 70/139] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:01:32 2022] GET /compute/v2.1/servers/5cfd118b-cc42-4dbe-93f1-784454892318 => generated 1367 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:01:32.479304 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-c1d59ee9-496b-4900-b168-21cc2f95bed4 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:01:32.479899 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-c1d59ee9-496b-4900-b168-21cc2f95bed4 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] [instance: f4c73822-1dfa-4eed-bf02-1123b0402755] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:01:32.498547 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-c1d59ee9-496b-4900-b168-21cc2f95bed4 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:32.498547 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-c1d59ee9-496b-4900-b168-21cc2f95bed4 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:32.498547 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-c1d59ee9-496b-4900-b168-21cc2f95bed4 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:32.503875 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-c1d59ee9-496b-4900-b168-21cc2f95bed4 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:32.590284 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-faece31e-dbf5-42f3-9e2f-61b93b8e633d tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '243e592fbf1844d89f55dd5035a684f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60447df5461141e883d207e028b74bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:32.601830 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-faece31e-dbf5-42f3-9e2f-61b93b8e633d tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] 10.222.0.17 "GET /compute/v2.1/servers/c2b8ba99-d845-4fca-b9e7-fc77ac91a601" status: 200 len: 1322 microversion: 2.1 time: 0.478960 Jun 16 23:01:32.602418 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 70/140] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:01:32 2022] GET /compute/v2.1/servers/c2b8ba99-d845-4fca-b9e7-fc77ac91a601 => generated 1322 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:01:32.617347 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-82071ec7-428e-4656-9c49-66eaaec5d1f9 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:01:32.618058 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-82071ec7-428e-4656-9c49-66eaaec5d1f9 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 46f43909-d681-4938-8253-5080b626e169] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:01:32.632625 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-82071ec7-428e-4656-9c49-66eaaec5d1f9 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:32.633053 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-82071ec7-428e-4656-9c49-66eaaec5d1f9 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:32.634543 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-82071ec7-428e-4656-9c49-66eaaec5d1f9 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:32.634543 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-82071ec7-428e-4656-9c49-66eaaec5d1f9 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:32.887348 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-c1d59ee9-496b-4900-b168-21cc2f95bed4 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a993f5d14b64fccad723abecfcadf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b1be8431b0434d8bd6abca293127d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:32.897677 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-c1d59ee9-496b-4900-b168-21cc2f95bed4 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] 10.222.0.17 "GET /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755" status: 200 len: 1363 microversion: 2.1 time: 0.433197 Jun 16 23:01:32.899595 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 71/141] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:01:32 2022] GET /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755 => generated 1363 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:01:32.921740 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-82071ec7-428e-4656-9c49-66eaaec5d1f9 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:32.931612 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-82071ec7-428e-4656-9c49-66eaaec5d1f9 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:32.933087 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-82071ec7-428e-4656-9c49-66eaaec5d1f9 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:32.934195 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-82071ec7-428e-4656-9c49-66eaaec5d1f9 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169" status: 200 len: 1406 microversion: 2.20 time: 0.320875 Jun 16 23:01:32.934799 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 71/142] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 23:01:32 2022] GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169 => generated 1406 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 23:01:33.480131 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-e9ece7f0-ad1c-4acc-abbb-b0c7918f0bb5 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:01:33.481151 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-e9ece7f0-ad1c-4acc-abbb-b0c7918f0bb5 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] [instance: 5cfd118b-cc42-4dbe-93f1-784454892318] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:01:33.489346 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-e9ece7f0-ad1c-4acc-abbb-b0c7918f0bb5 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:33.490071 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-e9ece7f0-ad1c-4acc-abbb-b0c7918f0bb5 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:33.491037 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-e9ece7f0-ad1c-4acc-abbb-b0c7918f0bb5 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:33.492061 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-e9ece7f0-ad1c-4acc-abbb-b0c7918f0bb5 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:33.619759 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-1995cee2-ca3f-4b53-a087-c24a089e1762 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:01:33.621917 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-1995cee2-ca3f-4b53-a087-c24a089e1762 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] [instance: c2b8ba99-d845-4fca-b9e7-fc77ac91a601] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:01:33.635867 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-1995cee2-ca3f-4b53-a087-c24a089e1762 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:33.636870 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-1995cee2-ca3f-4b53-a087-c24a089e1762 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:33.638050 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-1995cee2-ca3f-4b53-a087-c24a089e1762 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:33.639749 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-1995cee2-ca3f-4b53-a087-c24a089e1762 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:33.657516 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-e9ece7f0-ad1c-4acc-abbb-b0c7918f0bb5 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3a2d16133b4af8a208682de8a7d111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0526c12e8bc947209e24daf5ddfad7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:33.671042 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-e9ece7f0-ad1c-4acc-abbb-b0c7918f0bb5 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] 10.222.0.17 "GET /compute/v2.1/servers/5cfd118b-cc42-4dbe-93f1-784454892318" status: 200 len: 1367 microversion: 2.1 time: 0.194590 Jun 16 23:01:33.672015 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 72/143] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:01:33 2022] GET /compute/v2.1/servers/5cfd118b-cc42-4dbe-93f1-784454892318 => generated 1367 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:01:33.702056 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-c5a0d1d0-50af-4042-91f1-15d38acd3095 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "aa7d34a2-5eef-48f4-bee0-d92dc8481e02"}} {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 23:01:33.704298 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-c5a0d1d0-50af-4042-91f1-15d38acd3095 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] [instance: d40a3e67-031a-4ad7-bd79-7c7d9a3bece9] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:01:33.711398 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-c5a0d1d0-50af-4042-91f1-15d38acd3095 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:33.712107 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-c5a0d1d0-50af-4042-91f1-15d38acd3095 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:33.713457 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-c5a0d1d0-50af-4042-91f1-15d38acd3095 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:33.713911 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-c5a0d1d0-50af-4042-91f1-15d38acd3095 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:33.814158 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-1995cee2-ca3f-4b53-a087-c24a089e1762 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '243e592fbf1844d89f55dd5035a684f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60447df5461141e883d207e028b74bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:33.822566 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-1995cee2-ca3f-4b53-a087-c24a089e1762 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] 10.222.0.17 "GET /compute/v2.1/servers/c2b8ba99-d845-4fca-b9e7-fc77ac91a601" status: 200 len: 1516 microversion: 2.1 time: 0.207214 Jun 16 23:01:33.823590 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 72/144] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:01:33 2022] GET /compute/v2.1/servers/c2b8ba99-d845-4fca-b9e7-fc77ac91a601 => generated 1516 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:01:33.848221 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-3ae59887-9cae-4877-a417-19d585656930 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 23:01:33.849403 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-3ae59887-9cae-4877-a417-19d585656930 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] [instance: c2b8ba99-d845-4fca-b9e7-fc77ac91a601] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:01:33.856784 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-3ae59887-9cae-4877-a417-19d585656930 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:33.857897 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-3ae59887-9cae-4877-a417-19d585656930 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:33.858745 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-3ae59887-9cae-4877-a417-19d585656930 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:33.859188 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-3ae59887-9cae-4877-a417-19d585656930 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:33.930550 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.objects.instance [None req-3ae59887-9cae-4877-a417-19d585656930 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lazy-loading 'flavor' on Instance uuid c2b8ba99-d845-4fca-b9e7-fc77ac91a601 {{(pid=117562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 23:01:34.020258 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG dbcounter [-] [117562] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=117562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 23:01:34.057845 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-3ae59887-9cae-4877-a417-19d585656930 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] 10.222.0.17 "POST /compute/v2.1/servers/c2b8ba99-d845-4fca-b9e7-fc77ac91a601/action" status: 200 len: 32 microversion: 2.1 time: 0.218550 Jun 16 23:01:34.062221 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 73/145] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Jun 16 23:01:33 2022] POST /compute/v2.1/servers/c2b8ba99-d845-4fca-b9e7-fc77ac91a601/action => generated 32 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 23:01:34.068148 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-360ec509-b19b-45d0-8dde-9740fa0cd2eb tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:01:34.068847 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-360ec509-b19b-45d0-8dde-9740fa0cd2eb tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] [instance: f4c73822-1dfa-4eed-bf02-1123b0402755] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:01:34.075101 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-360ec509-b19b-45d0-8dde-9740fa0cd2eb tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:34.075558 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-360ec509-b19b-45d0-8dde-9740fa0cd2eb tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:34.076508 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-360ec509-b19b-45d0-8dde-9740fa0cd2eb tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:34.076951 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-360ec509-b19b-45d0-8dde-9740fa0cd2eb tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:34.213263 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-360ec509-b19b-45d0-8dde-9740fa0cd2eb tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a993f5d14b64fccad723abecfcadf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b1be8431b0434d8bd6abca293127d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:34.222036 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-360ec509-b19b-45d0-8dde-9740fa0cd2eb tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] 10.222.0.17 "GET /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755" status: 200 len: 1363 microversion: 2.1 time: 0.157905 Jun 16 23:01:34.222889 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 74/146] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:01:34 2022] GET /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755 => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:01:34.238539 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-e493a678-97d2-4a3e-bb13-5e0325f3dca2 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:01:34.239623 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-e493a678-97d2-4a3e-bb13-5e0325f3dca2 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 46f43909-d681-4938-8253-5080b626e169] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:01:34.248703 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-e493a678-97d2-4a3e-bb13-5e0325f3dca2 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:34.249238 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-e493a678-97d2-4a3e-bb13-5e0325f3dca2 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:34.250302 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-e493a678-97d2-4a3e-bb13-5e0325f3dca2 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:34.250769 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-e493a678-97d2-4a3e-bb13-5e0325f3dca2 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:34.394067 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-e493a678-97d2-4a3e-bb13-5e0325f3dca2 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:34.402462 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-e493a678-97d2-4a3e-bb13-5e0325f3dca2 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:34.404504 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-e493a678-97d2-4a3e-bb13-5e0325f3dca2 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:34.405608 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-e493a678-97d2-4a3e-bb13-5e0325f3dca2 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169" status: 200 len: 1406 microversion: 2.20 time: 0.172155 Jun 16 23:01:34.417142 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 75/147] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 23:01:34 2022] GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169 => generated 1406 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 23:01:34.423541 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-6686badd-47dc-4a19-8230-a89dc4f07c49 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:01:34.423541 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-6686badd-47dc-4a19-8230-a89dc4f07c49 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] [instance: c2b8ba99-d845-4fca-b9e7-fc77ac91a601] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:01:34.430525 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-6686badd-47dc-4a19-8230-a89dc4f07c49 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:34.431014 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-6686badd-47dc-4a19-8230-a89dc4f07c49 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:34.431791 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-6686badd-47dc-4a19-8230-a89dc4f07c49 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:34.432230 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-6686badd-47dc-4a19-8230-a89dc4f07c49 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:34.572975 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-6686badd-47dc-4a19-8230-a89dc4f07c49 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '243e592fbf1844d89f55dd5035a684f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60447df5461141e883d207e028b74bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:34.581361 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-6686badd-47dc-4a19-8230-a89dc4f07c49 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] 10.222.0.17 "GET /compute/v2.1/servers/c2b8ba99-d845-4fca-b9e7-fc77ac91a601" status: 200 len: 1522 microversion: 2.1 time: 0.162964 Jun 16 23:01:34.582278 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 76/148] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:01:34 2022] GET /compute/v2.1/servers/c2b8ba99-d845-4fca-b9e7-fc77ac91a601 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:01:34.689887 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-fddddc57-8157-4aef-b9ba-6b9ac51081c4 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:01:34.690959 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-fddddc57-8157-4aef-b9ba-6b9ac51081c4 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] [instance: 5cfd118b-cc42-4dbe-93f1-784454892318] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:01:34.697509 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-fddddc57-8157-4aef-b9ba-6b9ac51081c4 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:34.698077 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-fddddc57-8157-4aef-b9ba-6b9ac51081c4 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:34.698872 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-fddddc57-8157-4aef-b9ba-6b9ac51081c4 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:34.699314 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-fddddc57-8157-4aef-b9ba-6b9ac51081c4 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:34.860929 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-fddddc57-8157-4aef-b9ba-6b9ac51081c4 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3a2d16133b4af8a208682de8a7d111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0526c12e8bc947209e24daf5ddfad7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:34.874538 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-fddddc57-8157-4aef-b9ba-6b9ac51081c4 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] 10.222.0.17 "GET /compute/v2.1/servers/5cfd118b-cc42-4dbe-93f1-784454892318" status: 200 len: 1367 microversion: 2.1 time: 0.189324 Jun 16 23:01:34.875936 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 77/149] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:01:34 2022] GET /compute/v2.1/servers/5cfd118b-cc42-4dbe-93f1-784454892318 => generated 1367 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 23:01:35.241817 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-c8c17718-e273-4e05-ba3e-b9e9d4897feb tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:01:35.245148 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-c8c17718-e273-4e05-ba3e-b9e9d4897feb tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] [instance: f4c73822-1dfa-4eed-bf02-1123b0402755] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:01:35.253257 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-c8c17718-e273-4e05-ba3e-b9e9d4897feb tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:35.253976 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-c8c17718-e273-4e05-ba3e-b9e9d4897feb tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:35.255062 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-c8c17718-e273-4e05-ba3e-b9e9d4897feb tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:35.255499 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-c8c17718-e273-4e05-ba3e-b9e9d4897feb tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:35.514626 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-c8c17718-e273-4e05-ba3e-b9e9d4897feb tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a993f5d14b64fccad723abecfcadf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b1be8431b0434d8bd6abca293127d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:35.524500 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-c8c17718-e273-4e05-ba3e-b9e9d4897feb tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] 10.222.0.17 "GET /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755" status: 200 len: 1363 microversion: 2.1 time: 0.288424 Jun 16 23:01:35.525070 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 78/150] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:01:35 2022] GET /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755 => generated 1363 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 23:01:35.540114 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-a562bd00-f5ff-4691-9d4e-d7c360820d21 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:01:35.540990 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-a562bd00-f5ff-4691-9d4e-d7c360820d21 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 46f43909-d681-4938-8253-5080b626e169] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:01:35.548066 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-a562bd00-f5ff-4691-9d4e-d7c360820d21 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:35.548835 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-a562bd00-f5ff-4691-9d4e-d7c360820d21 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:35.549840 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-a562bd00-f5ff-4691-9d4e-d7c360820d21 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:35.550565 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-a562bd00-f5ff-4691-9d4e-d7c360820d21 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:35.952067 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-a562bd00-f5ff-4691-9d4e-d7c360820d21 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:35.968274 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-a562bd00-f5ff-4691-9d4e-d7c360820d21 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:35.970570 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-a562bd00-f5ff-4691-9d4e-d7c360820d21 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:35.972014 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-a562bd00-f5ff-4691-9d4e-d7c360820d21 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169" status: 200 len: 1406 microversion: 2.20 time: 0.443889 Jun 16 23:01:35.973084 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 79/151] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 23:01:35 2022] GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169 => generated 1406 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 23:01:35.987812 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-b5c3fb71-8afa-44fb-b2b5-5846f2e47c31 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:01:35.989445 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-b5c3fb71-8afa-44fb-b2b5-5846f2e47c31 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] [instance: c2b8ba99-d845-4fca-b9e7-fc77ac91a601] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:01:36.025384 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-b5c3fb71-8afa-44fb-b2b5-5846f2e47c31 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:36.026242 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-b5c3fb71-8afa-44fb-b2b5-5846f2e47c31 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:36.029807 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-b5c3fb71-8afa-44fb-b2b5-5846f2e47c31 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:36.031207 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-b5c3fb71-8afa-44fb-b2b5-5846f2e47c31 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:36.351189 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-b5c3fb71-8afa-44fb-b2b5-5846f2e47c31 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '243e592fbf1844d89f55dd5035a684f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60447df5461141e883d207e028b74bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:36.374011 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-b5c3fb71-8afa-44fb-b2b5-5846f2e47c31 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] 10.222.0.17 "GET /compute/v2.1/servers/c2b8ba99-d845-4fca-b9e7-fc77ac91a601" status: 200 len: 1522 microversion: 2.1 time: 0.390727 Jun 16 23:01:36.375515 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 80/152] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:01:35 2022] GET /compute/v2.1/servers/c2b8ba99-d845-4fca-b9e7-fc77ac91a601 => generated 1522 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:01:36.400072 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-c38fa056-c85e-491c-b66d-9d966acd6748 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:01:36.400983 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-c38fa056-c85e-491c-b66d-9d966acd6748 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] [instance: 5cfd118b-cc42-4dbe-93f1-784454892318] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:01:36.407272 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-c38fa056-c85e-491c-b66d-9d966acd6748 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:36.407682 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-c38fa056-c85e-491c-b66d-9d966acd6748 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:36.408658 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-c38fa056-c85e-491c-b66d-9d966acd6748 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:36.409089 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-c38fa056-c85e-491c-b66d-9d966acd6748 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:36.634639 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG dbcounter [-] [117563] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=117563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 23:01:36.737377 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-c38fa056-c85e-491c-b66d-9d966acd6748 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3a2d16133b4af8a208682de8a7d111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0526c12e8bc947209e24daf5ddfad7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:36.746343 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-c38fa056-c85e-491c-b66d-9d966acd6748 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] 10.222.0.17 "GET /compute/v2.1/servers/5cfd118b-cc42-4dbe-93f1-784454892318" status: 200 len: 1367 microversion: 2.1 time: 0.357044 Jun 16 23:01:36.749565 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 81/153] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:01:36 2022] GET /compute/v2.1/servers/5cfd118b-cc42-4dbe-93f1-784454892318 => generated 1367 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:01:36.760232 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-60d839a2-7636-44c5-88c7-ad4aa9ba0bac tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:01:36.760956 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-60d839a2-7636-44c5-88c7-ad4aa9ba0bac tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] [instance: f4c73822-1dfa-4eed-bf02-1123b0402755] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:01:36.778985 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-60d839a2-7636-44c5-88c7-ad4aa9ba0bac tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:36.779590 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-60d839a2-7636-44c5-88c7-ad4aa9ba0bac tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:36.780481 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-60d839a2-7636-44c5-88c7-ad4aa9ba0bac tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:36.781014 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-60d839a2-7636-44c5-88c7-ad4aa9ba0bac tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:36.928632 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-c5a0d1d0-50af-4042-91f1-15d38acd3095 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] 10.222.0.17 "POST /compute/v2.1/servers/d40a3e67-031a-4ad7-bd79-7c7d9a3bece9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.239766 Jun 16 23:01:36.929829 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 73/154] 10.222.0.17 () {60 vars in 1322 bytes} [Thu Jun 16 23:01:33 2022] POST /compute/v2.1/servers/d40a3e67-031a-4ad7-bd79-7c7d9a3bece9/os-volume_attachments => generated 194 bytes in 3243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 23:01:36.950909 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [req-153cedbb-c36c-4d81-a61a-d2a336421d9d req-9ae8bb59-728b-4f95-a644-15faa28f9bbc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4c73822-1dfa-4eed-bf02-1123b0402755", "name": "network-vif-plugged", "status": "completed", "tag": "a7d62259-83d7-4cc4-b290-3fa8f2b03ade"}]} {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 23:01:36.979291 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-153cedbb-c36c-4d81-a61a-d2a336421d9d req-9ae8bb59-728b-4f95-a644-15faa28f9bbc service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:36.980424 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-153cedbb-c36c-4d81-a61a-d2a336421d9d req-9ae8bb59-728b-4f95-a644-15faa28f9bbc service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:36.995854 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.compute.server_external_events [req-153cedbb-c36c-4d81-a61a-d2a336421d9d req-9ae8bb59-728b-4f95-a644-15faa28f9bbc service nova] Creating event network-vif-plugged:a7d62259-83d7-4cc4-b290-3fa8f2b03ade for instance f4c73822-1dfa-4eed-bf02-1123b0402755 on hv-cinder-84623 Jun 16 23:01:37.006562 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [req-153cedbb-c36c-4d81-a61a-d2a336421d9d req-9ae8bb59-728b-4f95-a644-15faa28f9bbc service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074698 Jun 16 23:01:37.007588 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 74/155] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 23:01:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 23:01:37.015177 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-618c7b22-f128-4692-8f6e-de338a5c4257 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:01:37.016946 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-618c7b22-f128-4692-8f6e-de338a5c4257 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 46f43909-d681-4938-8253-5080b626e169] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:01:37.024930 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-618c7b22-f128-4692-8f6e-de338a5c4257 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:37.025612 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-618c7b22-f128-4692-8f6e-de338a5c4257 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:37.027068 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-618c7b22-f128-4692-8f6e-de338a5c4257 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:37.027772 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-618c7b22-f128-4692-8f6e-de338a5c4257 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:37.615452 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-60d839a2-7636-44c5-88c7-ad4aa9ba0bac tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a993f5d14b64fccad723abecfcadf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b1be8431b0434d8bd6abca293127d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:37.623871 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-60d839a2-7636-44c5-88c7-ad4aa9ba0bac tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] 10.222.0.17 "GET /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755" status: 200 len: 1363 microversion: 2.1 time: 0.872988 Jun 16 23:01:37.625500 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 82/156] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:01:36 2022] GET /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755 => generated 1363 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:01:37.639416 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-2d130aa2-7627-445f-8da4-40c7fc4c519b tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:01:37.641850 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-2d130aa2-7627-445f-8da4-40c7fc4c519b tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] [instance: c2b8ba99-d845-4fca-b9e7-fc77ac91a601] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:01:37.657855 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-2d130aa2-7627-445f-8da4-40c7fc4c519b tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:37.658289 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-2d130aa2-7627-445f-8da4-40c7fc4c519b tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:37.659291 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-2d130aa2-7627-445f-8da4-40c7fc4c519b tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:37.659719 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-2d130aa2-7627-445f-8da4-40c7fc4c519b tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:37.674695 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-618c7b22-f128-4692-8f6e-de338a5c4257 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:37.682787 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-618c7b22-f128-4692-8f6e-de338a5c4257 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:37.693709 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-618c7b22-f128-4692-8f6e-de338a5c4257 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:37.695267 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-618c7b22-f128-4692-8f6e-de338a5c4257 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169" status: 200 len: 1406 microversion: 2.20 time: 0.686215 Jun 16 23:01:37.696047 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 75/157] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 23:01:37 2022] GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169 => generated 1406 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 23:01:37.767990 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-8e0fc068-0207-4f48-9deb-e45fd7997017 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:01:37.769029 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-8e0fc068-0207-4f48-9deb-e45fd7997017 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] [instance: 5cfd118b-cc42-4dbe-93f1-784454892318] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:01:37.780421 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-8e0fc068-0207-4f48-9deb-e45fd7997017 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:37.781203 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-8e0fc068-0207-4f48-9deb-e45fd7997017 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:37.783204 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-8e0fc068-0207-4f48-9deb-e45fd7997017 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:37.783868 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-8e0fc068-0207-4f48-9deb-e45fd7997017 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:38.118692 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-2d130aa2-7627-445f-8da4-40c7fc4c519b tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '243e592fbf1844d89f55dd5035a684f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60447df5461141e883d207e028b74bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:38.128520 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-2d130aa2-7627-445f-8da4-40c7fc4c519b tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] 10.222.0.17 "GET /compute/v2.1/servers/c2b8ba99-d845-4fca-b9e7-fc77ac91a601" status: 200 len: 1522 microversion: 2.1 time: 0.499965 Jun 16 23:01:38.129621 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 83/158] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:01:37 2022] GET /compute/v2.1/servers/c2b8ba99-d845-4fca-b9e7-fc77ac91a601 => generated 1522 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:01:38.157279 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-8e0fc068-0207-4f48-9deb-e45fd7997017 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3a2d16133b4af8a208682de8a7d111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0526c12e8bc947209e24daf5ddfad7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:38.166546 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-8e0fc068-0207-4f48-9deb-e45fd7997017 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] 10.222.0.17 "GET /compute/v2.1/servers/5cfd118b-cc42-4dbe-93f1-784454892318" status: 200 len: 1367 microversion: 2.1 time: 0.404212 Jun 16 23:01:38.169694 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 76/159] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:01:37 2022] GET /compute/v2.1/servers/5cfd118b-cc42-4dbe-93f1-784454892318 => generated 1367 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:01:38.641685 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-86afaca3-26ba-4840-8fff-d54b1c1477e1 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:01:38.643062 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-86afaca3-26ba-4840-8fff-d54b1c1477e1 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] [instance: f4c73822-1dfa-4eed-bf02-1123b0402755] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:01:38.650238 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-86afaca3-26ba-4840-8fff-d54b1c1477e1 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:38.650944 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-86afaca3-26ba-4840-8fff-d54b1c1477e1 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:38.651873 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-86afaca3-26ba-4840-8fff-d54b1c1477e1 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:38.652459 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-86afaca3-26ba-4840-8fff-d54b1c1477e1 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:38.713367 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-ed280e65-0647-4e21-9f04-0217c592feac tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:01:38.713977 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-ed280e65-0647-4e21-9f04-0217c592feac tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 46f43909-d681-4938-8253-5080b626e169] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:01:38.728349 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-ed280e65-0647-4e21-9f04-0217c592feac tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:38.728999 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-ed280e65-0647-4e21-9f04-0217c592feac tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:38.729955 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-ed280e65-0647-4e21-9f04-0217c592feac tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:38.730990 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-ed280e65-0647-4e21-9f04-0217c592feac tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:39.047421 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-86afaca3-26ba-4840-8fff-d54b1c1477e1 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a993f5d14b64fccad723abecfcadf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b1be8431b0434d8bd6abca293127d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:39.051978 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-ed280e65-0647-4e21-9f04-0217c592feac tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:39.061854 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-ed280e65-0647-4e21-9f04-0217c592feac tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:39.062101 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-86afaca3-26ba-4840-8fff-d54b1c1477e1 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] 10.222.0.17 "GET /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755" status: 200 len: 1363 microversion: 2.1 time: 0.423893 Jun 16 23:01:39.064014 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 84/160] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:01:38 2022] GET /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755 => generated 1363 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:01:39.074758 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-ed280e65-0647-4e21-9f04-0217c592feac tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:39.074758 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-ed280e65-0647-4e21-9f04-0217c592feac tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169" status: 200 len: 1406 microversion: 2.20 time: 0.356881 Jun 16 23:01:39.074758 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 77/161] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 23:01:38 2022] GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169 => generated 1406 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 23:01:39.145167 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-d8e644e1-8bfd-4ba1-b002-a1bd8cba4ef2 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:01:39.145784 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-d8e644e1-8bfd-4ba1-b002-a1bd8cba4ef2 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] [instance: c2b8ba99-d845-4fca-b9e7-fc77ac91a601] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:01:39.152084 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-d8e644e1-8bfd-4ba1-b002-a1bd8cba4ef2 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:39.152561 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-d8e644e1-8bfd-4ba1-b002-a1bd8cba4ef2 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:39.153573 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-d8e644e1-8bfd-4ba1-b002-a1bd8cba4ef2 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:39.161956 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-d8e644e1-8bfd-4ba1-b002-a1bd8cba4ef2 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:39.185747 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-f37f369f-6a02-42fa-999d-461157412862 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:01:39.186362 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-f37f369f-6a02-42fa-999d-461157412862 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] [instance: 5cfd118b-cc42-4dbe-93f1-784454892318] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:01:39.199873 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-f37f369f-6a02-42fa-999d-461157412862 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:39.200603 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-f37f369f-6a02-42fa-999d-461157412862 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:39.201536 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-f37f369f-6a02-42fa-999d-461157412862 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:39.201974 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-f37f369f-6a02-42fa-999d-461157412862 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:39.517003 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-d8e644e1-8bfd-4ba1-b002-a1bd8cba4ef2 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '243e592fbf1844d89f55dd5035a684f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60447df5461141e883d207e028b74bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:39.525605 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-d8e644e1-8bfd-4ba1-b002-a1bd8cba4ef2 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] 10.222.0.17 "GET /compute/v2.1/servers/c2b8ba99-d845-4fca-b9e7-fc77ac91a601" status: 200 len: 1522 microversion: 2.1 time: 0.384082 Jun 16 23:01:39.526054 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 78/162] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:01:39 2022] GET /compute/v2.1/servers/c2b8ba99-d845-4fca-b9e7-fc77ac91a601 => generated 1522 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:01:39.537345 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-f37f369f-6a02-42fa-999d-461157412862 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3a2d16133b4af8a208682de8a7d111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0526c12e8bc947209e24daf5ddfad7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:39.549169 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-f37f369f-6a02-42fa-999d-461157412862 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] 10.222.0.17 "GET /compute/v2.1/servers/5cfd118b-cc42-4dbe-93f1-784454892318" status: 200 len: 1367 microversion: 2.1 time: 0.367197 Jun 16 23:01:39.550508 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 85/163] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:01:39 2022] GET /compute/v2.1/servers/5cfd118b-cc42-4dbe-93f1-784454892318 => generated 1367 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 23:01:40.086113 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-00857f30-4c7b-4e41-8444-058e1e01506f tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:01:40.087743 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-e22f122e-1eb2-4eac-afa6-f5336a7697d0 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:01:40.088301 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-00857f30-4c7b-4e41-8444-058e1e01506f tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 46f43909-d681-4938-8253-5080b626e169] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:01:40.088720 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-e22f122e-1eb2-4eac-afa6-f5336a7697d0 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] [instance: f4c73822-1dfa-4eed-bf02-1123b0402755] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:01:40.100654 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-00857f30-4c7b-4e41-8444-058e1e01506f tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:40.102439 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-e22f122e-1eb2-4eac-afa6-f5336a7697d0 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:40.102985 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-00857f30-4c7b-4e41-8444-058e1e01506f tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:40.104066 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-00857f30-4c7b-4e41-8444-058e1e01506f tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:40.104594 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-e22f122e-1eb2-4eac-afa6-f5336a7697d0 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:40.105767 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-e22f122e-1eb2-4eac-afa6-f5336a7697d0 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:40.106488 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-00857f30-4c7b-4e41-8444-058e1e01506f tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:40.108636 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-e22f122e-1eb2-4eac-afa6-f5336a7697d0 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:40.470987 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-00857f30-4c7b-4e41-8444-058e1e01506f tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:40.477209 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-e22f122e-1eb2-4eac-afa6-f5336a7697d0 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a993f5d14b64fccad723abecfcadf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b1be8431b0434d8bd6abca293127d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:40.488027 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-e22f122e-1eb2-4eac-afa6-f5336a7697d0 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] 10.222.0.17 "GET /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755" status: 200 len: 1549 microversion: 2.1 time: 0.410475 Jun 16 23:01:40.489931 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-00857f30-4c7b-4e41-8444-058e1e01506f tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:40.492639 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-00857f30-4c7b-4e41-8444-058e1e01506f tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:40.493782 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-00857f30-4c7b-4e41-8444-058e1e01506f tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169" status: 200 len: 1406 microversion: 2.20 time: 0.413409 Jun 16 23:01:40.494332 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 86/164] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 23:01:40 2022] GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169 => generated 1406 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 23:01:40.501206 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 79/165] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:01:40 2022] GET /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755 => generated 1549 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:01:40.521946 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-4ccb2f1f-d72d-4300-ba27-bbd5b23a60c4 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:01:40.522455 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-4ccb2f1f-d72d-4300-ba27-bbd5b23a60c4 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] [instance: f4c73822-1dfa-4eed-bf02-1123b0402755] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:01:40.538691 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-4ccb2f1f-d72d-4300-ba27-bbd5b23a60c4 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:40.539155 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-4ccb2f1f-d72d-4300-ba27-bbd5b23a60c4 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:40.539952 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-4ccb2f1f-d72d-4300-ba27-bbd5b23a60c4 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:40.541495 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-4ccb2f1f-d72d-4300-ba27-bbd5b23a60c4 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:40.545778 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-677c1ae6-f101-4838-91dd-5564772d0280 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:01:40.547025 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-677c1ae6-f101-4838-91dd-5564772d0280 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] [instance: c2b8ba99-d845-4fca-b9e7-fc77ac91a601] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:01:40.557304 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-677c1ae6-f101-4838-91dd-5564772d0280 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:40.558951 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-677c1ae6-f101-4838-91dd-5564772d0280 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:40.562839 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-677c1ae6-f101-4838-91dd-5564772d0280 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:40.563754 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-677c1ae6-f101-4838-91dd-5564772d0280 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:40.810150 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-4ccb2f1f-d72d-4300-ba27-bbd5b23a60c4 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] 10.222.0.17 "GET /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.297518 Jun 16 23:01:40.811472 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 87/166] 10.222.0.17 () {58 vars in 1274 bytes} [Thu Jun 16 23:01:40 2022] GET /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755/os-interface => generated 285 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 23:01:40.821072 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-1fa5330c-7729-466f-9a1d-ec44e55b9caf tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:01:40.822093 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-1fa5330c-7729-466f-9a1d-ec44e55b9caf tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] [instance: 5cfd118b-cc42-4dbe-93f1-784454892318] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:01:40.830278 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-1fa5330c-7729-466f-9a1d-ec44e55b9caf tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:40.831127 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-1fa5330c-7729-466f-9a1d-ec44e55b9caf tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:40.832248 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-1fa5330c-7729-466f-9a1d-ec44e55b9caf tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:40.833186 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-1fa5330c-7729-466f-9a1d-ec44e55b9caf tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:40.888336 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-677c1ae6-f101-4838-91dd-5564772d0280 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '243e592fbf1844d89f55dd5035a684f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60447df5461141e883d207e028b74bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:40.918688 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-677c1ae6-f101-4838-91dd-5564772d0280 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] 10.222.0.17 "GET /compute/v2.1/servers/c2b8ba99-d845-4fca-b9e7-fc77ac91a601" status: 200 len: 1522 microversion: 2.1 time: 0.377593 Jun 16 23:01:40.921861 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 80/167] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:01:40 2022] GET /compute/v2.1/servers/c2b8ba99-d845-4fca-b9e7-fc77ac91a601 => generated 1522 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 23:01:41.307705 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-1fa5330c-7729-466f-9a1d-ec44e55b9caf tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3a2d16133b4af8a208682de8a7d111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0526c12e8bc947209e24daf5ddfad7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:41.320650 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-1fa5330c-7729-466f-9a1d-ec44e55b9caf tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] 10.222.0.17 "GET /compute/v2.1/servers/5cfd118b-cc42-4dbe-93f1-784454892318" status: 200 len: 1367 microversion: 2.1 time: 0.506843 Jun 16 23:01:41.321532 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 88/168] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:01:40 2022] GET /compute/v2.1/servers/5cfd118b-cc42-4dbe-93f1-784454892318 => generated 1367 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:01:41.513500 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-48e06d62-fb8d-47e2-bd38-beb875fd5427 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:01:41.514406 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-48e06d62-fb8d-47e2-bd38-beb875fd5427 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 46f43909-d681-4938-8253-5080b626e169] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:01:41.520336 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG dbcounter [-] [117563] Writing DB stats nova_api:SELECT=100 {{(pid=117563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 23:01:41.527555 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-48e06d62-fb8d-47e2-bd38-beb875fd5427 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:41.528020 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-48e06d62-fb8d-47e2-bd38-beb875fd5427 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:41.528809 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-48e06d62-fb8d-47e2-bd38-beb875fd5427 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:41.529365 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-48e06d62-fb8d-47e2-bd38-beb875fd5427 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:41.824394 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-48e06d62-fb8d-47e2-bd38-beb875fd5427 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:41.833020 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-48e06d62-fb8d-47e2-bd38-beb875fd5427 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:41.834563 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-48e06d62-fb8d-47e2-bd38-beb875fd5427 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:41.835753 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-48e06d62-fb8d-47e2-bd38-beb875fd5427 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169" status: 200 len: 1406 microversion: 2.20 time: 0.326202 Jun 16 23:01:41.836324 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 81/169] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 23:01:41 2022] GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169 => generated 1406 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 23:01:41.939891 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-16c2065c-7a41-463a-b1c1-44b692e4ce52 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:01:41.941772 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-16c2065c-7a41-463a-b1c1-44b692e4ce52 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] [instance: c2b8ba99-d845-4fca-b9e7-fc77ac91a601] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:01:41.959700 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-16c2065c-7a41-463a-b1c1-44b692e4ce52 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:41.972499 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-16c2065c-7a41-463a-b1c1-44b692e4ce52 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:41.974224 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-16c2065c-7a41-463a-b1c1-44b692e4ce52 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:41.974902 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-16c2065c-7a41-463a-b1c1-44b692e4ce52 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:42.348340 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-bb809d7e-40a5-4ecc-815e-5d3be6c4a28c tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:01:42.349272 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-bb809d7e-40a5-4ecc-815e-5d3be6c4a28c tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] [instance: 5cfd118b-cc42-4dbe-93f1-784454892318] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:01:42.357098 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-bb809d7e-40a5-4ecc-815e-5d3be6c4a28c tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:42.358058 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-bb809d7e-40a5-4ecc-815e-5d3be6c4a28c tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:42.358949 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-bb809d7e-40a5-4ecc-815e-5d3be6c4a28c tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:42.367500 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-bb809d7e-40a5-4ecc-815e-5d3be6c4a28c tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:42.697086 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-16c2065c-7a41-463a-b1c1-44b692e4ce52 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '243e592fbf1844d89f55dd5035a684f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60447df5461141e883d207e028b74bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:42.705560 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-16c2065c-7a41-463a-b1c1-44b692e4ce52 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] 10.222.0.17 "GET /compute/v2.1/servers/c2b8ba99-d845-4fca-b9e7-fc77ac91a601" status: 200 len: 1522 microversion: 2.1 time: 0.771325 Jun 16 23:01:42.706124 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 89/170] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:01:41 2022] GET /compute/v2.1/servers/c2b8ba99-d845-4fca-b9e7-fc77ac91a601 => generated 1522 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:01:42.785117 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [req-4988b902-fd20-4537-ae7a-ee39fa2b593f req-f8dae851-d967-4144-9b18-e370839bd183 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46f43909-d681-4938-8253-5080b626e169", "name": "network-vif-plugged", "status": "completed", "tag": "42e82895-598b-468f-aac2-e51ebe9d9946"}]} {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 23:01:42.800324 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [req-4988b902-fd20-4537-ae7a-ee39fa2b593f req-f8dae851-d967-4144-9b18-e370839bd183 service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:42.806529 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [req-4988b902-fd20-4537-ae7a-ee39fa2b593f req-f8dae851-d967-4144-9b18-e370839bd183 service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:42.845931 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG dbcounter [-] [117562] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 23:01:42.849242 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.compute.server_external_events [req-4988b902-fd20-4537-ae7a-ee39fa2b593f req-f8dae851-d967-4144-9b18-e370839bd183 service nova] Creating event network-vif-plugged:42e82895-598b-468f-aac2-e51ebe9d9946 for instance 46f43909-d681-4938-8253-5080b626e169 on hv-cinder-84623 Jun 16 23:01:42.867077 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [req-4988b902-fd20-4537-ae7a-ee39fa2b593f req-f8dae851-d967-4144-9b18-e370839bd183 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087862 Jun 16 23:01:42.871700 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 90/171] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 23:01:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 23:01:42.891342 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-56c4d764-20fa-4d28-8c14-4245d0602a6a tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:01:42.892632 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-56c4d764-20fa-4d28-8c14-4245d0602a6a tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 46f43909-d681-4938-8253-5080b626e169] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:01:42.908036 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-56c4d764-20fa-4d28-8c14-4245d0602a6a tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:42.911455 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-56c4d764-20fa-4d28-8c14-4245d0602a6a tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:42.912570 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-56c4d764-20fa-4d28-8c14-4245d0602a6a tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:42.914283 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-56c4d764-20fa-4d28-8c14-4245d0602a6a tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:43.152961 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-bb809d7e-40a5-4ecc-815e-5d3be6c4a28c tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3a2d16133b4af8a208682de8a7d111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0526c12e8bc947209e24daf5ddfad7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:43.165869 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-bb809d7e-40a5-4ecc-815e-5d3be6c4a28c tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] 10.222.0.17 "GET /compute/v2.1/servers/5cfd118b-cc42-4dbe-93f1-784454892318" status: 200 len: 1367 microversion: 2.1 time: 0.830197 Jun 16 23:01:43.166515 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 82/172] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:01:42 2022] GET /compute/v2.1/servers/5cfd118b-cc42-4dbe-93f1-784454892318 => generated 1367 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 23:01:43.426807 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-56c4d764-20fa-4d28-8c14-4245d0602a6a tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:43.442474 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-56c4d764-20fa-4d28-8c14-4245d0602a6a tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:43.448182 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-56c4d764-20fa-4d28-8c14-4245d0602a6a tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:43.453964 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-56c4d764-20fa-4d28-8c14-4245d0602a6a tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169" status: 200 len: 1406 microversion: 2.20 time: 0.578396 Jun 16 23:01:43.470670 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 91/173] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 23:01:42 2022] GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169 => generated 1406 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 23:01:43.532323 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [req-07456e63-8900-4d87-81f1-c73e81328347 req-2d2e0be2-1594-4cb5-9670-c4736cf1b495 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4c73822-1dfa-4eed-bf02-1123b0402755", "tag": "a7d62259-83d7-4cc4-b290-3fa8f2b03ade"}]} {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 23:01:43.548804 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-07456e63-8900-4d87-81f1-c73e81328347 req-2d2e0be2-1594-4cb5-9670-c4736cf1b495 service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:43.549288 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-07456e63-8900-4d87-81f1-c73e81328347 req-2d2e0be2-1594-4cb5-9670-c4736cf1b495 service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:43.574443 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.compute.server_external_events [req-07456e63-8900-4d87-81f1-c73e81328347 req-2d2e0be2-1594-4cb5-9670-c4736cf1b495 service nova] Creating event network-changed:a7d62259-83d7-4cc4-b290-3fa8f2b03ade for instance f4c73822-1dfa-4eed-bf02-1123b0402755 on hv-cinder-84623 Jun 16 23:01:43.590859 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [req-07456e63-8900-4d87-81f1-c73e81328347 req-2d2e0be2-1594-4cb5-9670-c4736cf1b495 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062112 Jun 16 23:01:43.595782 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 83/174] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 23:01:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 23:01:43.722916 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-38868eaa-71ef-4037-b04f-1ec939eae185 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:01:43.723534 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-38868eaa-71ef-4037-b04f-1ec939eae185 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] [instance: c2b8ba99-d845-4fca-b9e7-fc77ac91a601] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:01:43.739747 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-38868eaa-71ef-4037-b04f-1ec939eae185 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:43.740128 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-38868eaa-71ef-4037-b04f-1ec939eae185 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:43.740949 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-38868eaa-71ef-4037-b04f-1ec939eae185 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:43.741393 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-38868eaa-71ef-4037-b04f-1ec939eae185 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:43.805393 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-ab9f0818-9b8c-4e57-a596-9a340ee83f2d tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:01:43.805984 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-ab9f0818-9b8c-4e57-a596-9a340ee83f2d tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] [instance: d40a3e67-031a-4ad7-bd79-7c7d9a3bece9] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:01:43.822405 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-ab9f0818-9b8c-4e57-a596-9a340ee83f2d tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:43.824771 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-ab9f0818-9b8c-4e57-a596-9a340ee83f2d tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:43.825622 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-ab9f0818-9b8c-4e57-a596-9a340ee83f2d tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:43.826066 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-ab9f0818-9b8c-4e57-a596-9a340ee83f2d tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:43.897809 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-ab9f0818-9b8c-4e57-a596-9a340ee83f2d tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] [instance: d40a3e67-031a-4ad7-bd79-7c7d9a3bece9] Going to try to terminate instance {{(pid=117563) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 23:01:44.139901 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-ab9f0818-9b8c-4e57-a596-9a340ee83f2d tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] 10.222.0.17 "DELETE /compute/v2.1/servers/d40a3e67-031a-4ad7-bd79-7c7d9a3bece9" status: 204 len: 0 microversion: 2.1 time: 0.338477 Jun 16 23:01:44.141058 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 84/175] 10.222.0.17 () {58 vars in 1238 bytes} [Thu Jun 16 23:01:43 2022] DELETE /compute/v2.1/servers/d40a3e67-031a-4ad7-bd79-7c7d9a3bece9 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 16 23:01:44.154505 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-a42c8a16-3170-4047-9860-b65f7c6da985 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:01:44.156067 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-a42c8a16-3170-4047-9860-b65f7c6da985 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] [instance: d40a3e67-031a-4ad7-bd79-7c7d9a3bece9] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:01:44.167319 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-a42c8a16-3170-4047-9860-b65f7c6da985 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:44.169945 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-a42c8a16-3170-4047-9860-b65f7c6da985 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:44.171810 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-a42c8a16-3170-4047-9860-b65f7c6da985 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:44.174543 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-38868eaa-71ef-4037-b04f-1ec939eae185 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '243e592fbf1844d89f55dd5035a684f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60447df5461141e883d207e028b74bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:44.175408 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-a42c8a16-3170-4047-9860-b65f7c6da985 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:44.185440 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-38868eaa-71ef-4037-b04f-1ec939eae185 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] 10.222.0.17 "GET /compute/v2.1/servers/c2b8ba99-d845-4fca-b9e7-fc77ac91a601" status: 200 len: 1522 microversion: 2.1 time: 0.466917 Jun 16 23:01:44.188196 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 92/176] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:01:43 2022] GET /compute/v2.1/servers/c2b8ba99-d845-4fca-b9e7-fc77ac91a601 => generated 1522 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:01:44.193036 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-48c1323d-02ce-4fe5-b766-40b8c7df784d tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:01:44.193647 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-48c1323d-02ce-4fe5-b766-40b8c7df784d tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] [instance: 5cfd118b-cc42-4dbe-93f1-784454892318] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:01:44.210718 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-48c1323d-02ce-4fe5-b766-40b8c7df784d tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:44.211453 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-48c1323d-02ce-4fe5-b766-40b8c7df784d tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:44.212389 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-48c1323d-02ce-4fe5-b766-40b8c7df784d tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:44.222956 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-48c1323d-02ce-4fe5-b766-40b8c7df784d tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:44.693462 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-a42c8a16-3170-4047-9860-b65f7c6da985 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a6c4623c5f471b8241257180b64d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2300d78ad8244e3be17c1f388603de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:44.699335 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-48c1323d-02ce-4fe5-b766-40b8c7df784d tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3a2d16133b4af8a208682de8a7d111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0526c12e8bc947209e24daf5ddfad7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:44.701927 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-a42c8a16-3170-4047-9860-b65f7c6da985 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] 10.222.0.17 "GET /compute/v2.1/servers/d40a3e67-031a-4ad7-bd79-7c7d9a3bece9" status: 200 len: 1551 microversion: 2.1 time: 0.554569 Jun 16 23:01:44.710166 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 85/177] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:01:44 2022] GET /compute/v2.1/servers/d40a3e67-031a-4ad7-bd79-7c7d9a3bece9 => generated 1551 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:01:44.718418 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-1a477321-7e14-4d6d-b6c5-0a0861c95315 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:01:44.719252 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-1a477321-7e14-4d6d-b6c5-0a0861c95315 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 46f43909-d681-4938-8253-5080b626e169] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:01:44.719515 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-48c1323d-02ce-4fe5-b766-40b8c7df784d tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] 10.222.0.17 "GET /compute/v2.1/servers/5cfd118b-cc42-4dbe-93f1-784454892318" status: 200 len: 1367 microversion: 2.1 time: 0.530215 Jun 16 23:01:44.720109 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 93/178] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:01:44 2022] GET /compute/v2.1/servers/5cfd118b-cc42-4dbe-93f1-784454892318 => generated 1367 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:01:44.737680 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-1a477321-7e14-4d6d-b6c5-0a0861c95315 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:44.738294 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-1a477321-7e14-4d6d-b6c5-0a0861c95315 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:44.739382 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-1a477321-7e14-4d6d-b6c5-0a0861c95315 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:44.747838 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-1a477321-7e14-4d6d-b6c5-0a0861c95315 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:45.205972 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-daea592e-94d4-42d8-aa5f-00cee3231c48 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:01:45.207316 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-daea592e-94d4-42d8-aa5f-00cee3231c48 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] [instance: c2b8ba99-d845-4fca-b9e7-fc77ac91a601] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:01:45.228103 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-daea592e-94d4-42d8-aa5f-00cee3231c48 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:45.231155 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-daea592e-94d4-42d8-aa5f-00cee3231c48 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:45.239642 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-daea592e-94d4-42d8-aa5f-00cee3231c48 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:45.243764 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-daea592e-94d4-42d8-aa5f-00cee3231c48 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:45.899208 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-1a477321-7e14-4d6d-b6c5-0a0861c95315 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:45.912852 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-1a477321-7e14-4d6d-b6c5-0a0861c95315 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:45.917054 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-1a477321-7e14-4d6d-b6c5-0a0861c95315 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:45.923085 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-1a477321-7e14-4d6d-b6c5-0a0861c95315 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169" status: 200 len: 1406 microversion: 2.20 time: 1.208621 Jun 16 23:01:45.924547 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 86/179] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 23:01:44 2022] GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169 => generated 1406 bytes in 1214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 23:01:45.931607 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-b0c7e4df-2870-404d-97e2-d1683361cdc9 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:01:45.932527 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-b0c7e4df-2870-404d-97e2-d1683361cdc9 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] [instance: d40a3e67-031a-4ad7-bd79-7c7d9a3bece9] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:01:45.945063 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-b0c7e4df-2870-404d-97e2-d1683361cdc9 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:45.945788 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-b0c7e4df-2870-404d-97e2-d1683361cdc9 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:45.947297 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-b0c7e4df-2870-404d-97e2-d1683361cdc9 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:45.948167 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-b0c7e4df-2870-404d-97e2-d1683361cdc9 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:46.021637 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-daea592e-94d4-42d8-aa5f-00cee3231c48 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '243e592fbf1844d89f55dd5035a684f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60447df5461141e883d207e028b74bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:46.029919 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-daea592e-94d4-42d8-aa5f-00cee3231c48 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] 10.222.0.17 "GET /compute/v2.1/servers/c2b8ba99-d845-4fca-b9e7-fc77ac91a601" status: 200 len: 1522 microversion: 2.1 time: 0.828238 Jun 16 23:01:46.033042 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 94/180] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:01:45 2022] GET /compute/v2.1/servers/c2b8ba99-d845-4fca-b9e7-fc77ac91a601 => generated 1522 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 23:01:46.050226 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-77934ad4-ce97-4dc7-8f0f-fc0f01c0b6ad tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:01:46.054299 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-77934ad4-ce97-4dc7-8f0f-fc0f01c0b6ad tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] [instance: 5cfd118b-cc42-4dbe-93f1-784454892318] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:01:46.073841 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-77934ad4-ce97-4dc7-8f0f-fc0f01c0b6ad tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:46.074434 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-77934ad4-ce97-4dc7-8f0f-fc0f01c0b6ad tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:46.075512 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-77934ad4-ce97-4dc7-8f0f-fc0f01c0b6ad tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:46.075986 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-77934ad4-ce97-4dc7-8f0f-fc0f01c0b6ad tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:46.528582 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-b0c7e4df-2870-404d-97e2-d1683361cdc9 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a6c4623c5f471b8241257180b64d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2300d78ad8244e3be17c1f388603de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:46.542232 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-b0c7e4df-2870-404d-97e2-d1683361cdc9 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] 10.222.0.17 "GET /compute/v2.1/servers/d40a3e67-031a-4ad7-bd79-7c7d9a3bece9" status: 200 len: 1551 microversion: 2.1 time: 0.615489 Jun 16 23:01:46.543350 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 87/181] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:01:45 2022] GET /compute/v2.1/servers/d40a3e67-031a-4ad7-bd79-7c7d9a3bece9 => generated 1551 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:01:46.644108 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-77934ad4-ce97-4dc7-8f0f-fc0f01c0b6ad tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3a2d16133b4af8a208682de8a7d111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0526c12e8bc947209e24daf5ddfad7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:46.655083 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-77934ad4-ce97-4dc7-8f0f-fc0f01c0b6ad tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] 10.222.0.17 "GET /compute/v2.1/servers/5cfd118b-cc42-4dbe-93f1-784454892318" status: 200 len: 1367 microversion: 2.1 time: 0.617921 Jun 16 23:01:46.667085 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 95/182] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:01:46 2022] GET /compute/v2.1/servers/5cfd118b-cc42-4dbe-93f1-784454892318 => generated 1367 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:01:46.941417 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-cbf15f08-3759-42f7-a67d-8087256fb4e2 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:01:46.942024 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-cbf15f08-3759-42f7-a67d-8087256fb4e2 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 46f43909-d681-4938-8253-5080b626e169] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:01:46.951879 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-cbf15f08-3759-42f7-a67d-8087256fb4e2 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:46.952631 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-cbf15f08-3759-42f7-a67d-8087256fb4e2 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:46.953854 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-cbf15f08-3759-42f7-a67d-8087256fb4e2 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:46.954507 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-cbf15f08-3759-42f7-a67d-8087256fb4e2 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:47.053648 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-d8e9a355-1e27-40cd-a944-9f081574ea35 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:01:47.054722 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-d8e9a355-1e27-40cd-a944-9f081574ea35 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] [instance: c2b8ba99-d845-4fca-b9e7-fc77ac91a601] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:01:47.073531 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-d8e9a355-1e27-40cd-a944-9f081574ea35 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:47.075344 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-d8e9a355-1e27-40cd-a944-9f081574ea35 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:47.077081 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-d8e9a355-1e27-40cd-a944-9f081574ea35 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:47.077895 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-d8e9a355-1e27-40cd-a944-9f081574ea35 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:47.401318 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-cbf15f08-3759-42f7-a67d-8087256fb4e2 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:47.424663 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-cbf15f08-3759-42f7-a67d-8087256fb4e2 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:47.431075 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-cbf15f08-3759-42f7-a67d-8087256fb4e2 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:47.436026 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-cbf15f08-3759-42f7-a67d-8087256fb4e2 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169" status: 200 len: 1599 microversion: 2.20 time: 0.497236 Jun 16 23:01:47.439852 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 88/183] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 23:01:46 2022] GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169 => generated 1599 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 23:01:47.448473 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [req-e3834173-68a1-4c0e-b8c5-ff79b0742e65 req-826e0a35-2021-4586-aa84-f65c356a421b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5cfd118b-cc42-4dbe-93f1-784454892318", "name": "network-vif-plugged", "status": "completed", "tag": "cdc1a373-1b2c-4326-9d15-b3c2fc92a365"}]} {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 23:01:47.467540 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-e3834173-68a1-4c0e-b8c5-ff79b0742e65 req-826e0a35-2021-4586-aa84-f65c356a421b service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:47.471420 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-e3834173-68a1-4c0e-b8c5-ff79b0742e65 req-826e0a35-2021-4586-aa84-f65c356a421b service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:47.494090 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG dbcounter [-] [117563] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 23:01:47.504432 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.compute.server_external_events [req-e3834173-68a1-4c0e-b8c5-ff79b0742e65 req-826e0a35-2021-4586-aa84-f65c356a421b service nova] Creating event network-vif-plugged:cdc1a373-1b2c-4326-9d15-b3c2fc92a365 for instance 5cfd118b-cc42-4dbe-93f1-784454892318 on hv-cinder-84623 Jun 16 23:01:47.524190 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [req-e3834173-68a1-4c0e-b8c5-ff79b0742e65 req-826e0a35-2021-4586-aa84-f65c356a421b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082781 Jun 16 23:01:47.525377 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 89/184] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 23:01:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 23:01:47.530796 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-d8e9a355-1e27-40cd-a944-9f081574ea35 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '243e592fbf1844d89f55dd5035a684f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60447df5461141e883d207e028b74bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:47.547432 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-d8e9a355-1e27-40cd-a944-9f081574ea35 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] 10.222.0.17 "GET /compute/v2.1/servers/c2b8ba99-d845-4fca-b9e7-fc77ac91a601" status: 200 len: 1522 microversion: 2.1 time: 0.502159 Jun 16 23:01:47.559287 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 96/185] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:01:47 2022] GET /compute/v2.1/servers/c2b8ba99-d845-4fca-b9e7-fc77ac91a601 => generated 1522 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:01:47.562629 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-a1bb6c28-384a-41c4-bcb0-7360a0a2b703 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:01:47.563217 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-a1bb6c28-384a-41c4-bcb0-7360a0a2b703 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 46f43909-d681-4938-8253-5080b626e169] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:01:47.569066 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-7ba2effb-4496-4317-a9ce-f45c037e9ea4 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:01:47.569690 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-7ba2effb-4496-4317-a9ce-f45c037e9ea4 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] [instance: d40a3e67-031a-4ad7-bd79-7c7d9a3bece9] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:01:47.596671 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-7ba2effb-4496-4317-a9ce-f45c037e9ea4 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:47.597122 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-7ba2effb-4496-4317-a9ce-f45c037e9ea4 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:47.597893 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-7ba2effb-4496-4317-a9ce-f45c037e9ea4 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:47.600849 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-a1bb6c28-384a-41c4-bcb0-7360a0a2b703 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:47.602642 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-a1bb6c28-384a-41c4-bcb0-7360a0a2b703 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:47.603719 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-a1bb6c28-384a-41c4-bcb0-7360a0a2b703 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:47.611515 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-a1bb6c28-384a-41c4-bcb0-7360a0a2b703 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:47.612897 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-7ba2effb-4496-4317-a9ce-f45c037e9ea4 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:47.897465 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-a1bb6c28-384a-41c4-bcb0-7360a0a2b703 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.370821 Jun 16 23:01:47.898101 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 90/186] 10.222.0.17 () {60 vars in 1315 bytes} [Thu Jun 16 23:01:47 2022] GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169/os-interface => generated 285 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 23:01:47.908256 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-a0dfd524-dd7f-4f38-bc71-5e9d2adda822 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:01:47.909630 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-a0dfd524-dd7f-4f38-bc71-5e9d2adda822 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] [instance: 5cfd118b-cc42-4dbe-93f1-784454892318] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:01:47.922272 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-a0dfd524-dd7f-4f38-bc71-5e9d2adda822 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:47.923051 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-a0dfd524-dd7f-4f38-bc71-5e9d2adda822 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:47.926972 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-a0dfd524-dd7f-4f38-bc71-5e9d2adda822 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:47.927727 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-a0dfd524-dd7f-4f38-bc71-5e9d2adda822 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:48.226703 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-7ba2effb-4496-4317-a9ce-f45c037e9ea4 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a6c4623c5f471b8241257180b64d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2300d78ad8244e3be17c1f388603de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:48.251486 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-7ba2effb-4496-4317-a9ce-f45c037e9ea4 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] 10.222.0.17 "GET /compute/v2.1/servers/d40a3e67-031a-4ad7-bd79-7c7d9a3bece9" status: 200 len: 1551 microversion: 2.1 time: 0.690178 Jun 16 23:01:48.252086 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 97/187] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:01:47 2022] GET /compute/v2.1/servers/d40a3e67-031a-4ad7-bd79-7c7d9a3bece9 => generated 1551 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:01:48.313775 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-a0dfd524-dd7f-4f38-bc71-5e9d2adda822 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3a2d16133b4af8a208682de8a7d111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0526c12e8bc947209e24daf5ddfad7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:48.327262 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-a0dfd524-dd7f-4f38-bc71-5e9d2adda822 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] 10.222.0.17 "GET /compute/v2.1/servers/5cfd118b-cc42-4dbe-93f1-784454892318" status: 200 len: 1367 microversion: 2.1 time: 0.427119 Jun 16 23:01:48.328043 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 91/188] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:01:47 2022] GET /compute/v2.1/servers/5cfd118b-cc42-4dbe-93f1-784454892318 => generated 1367 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:01:48.577765 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-f34f4b37-23c4-4076-9a5d-31646391c240 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:01:48.579412 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-f34f4b37-23c4-4076-9a5d-31646391c240 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] [instance: c2b8ba99-d845-4fca-b9e7-fc77ac91a601] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:01:48.597038 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-f34f4b37-23c4-4076-9a5d-31646391c240 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:48.597493 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-f34f4b37-23c4-4076-9a5d-31646391c240 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:48.598260 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-f34f4b37-23c4-4076-9a5d-31646391c240 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:48.598722 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-f34f4b37-23c4-4076-9a5d-31646391c240 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:48.911794 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-f34f4b37-23c4-4076-9a5d-31646391c240 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '243e592fbf1844d89f55dd5035a684f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60447df5461141e883d207e028b74bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:48.921900 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-f34f4b37-23c4-4076-9a5d-31646391c240 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] 10.222.0.17 "GET /compute/v2.1/servers/c2b8ba99-d845-4fca-b9e7-fc77ac91a601" status: 200 len: 1522 microversion: 2.1 time: 0.350877 Jun 16 23:01:48.922776 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 98/189] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:01:48 2022] GET /compute/v2.1/servers/c2b8ba99-d845-4fca-b9e7-fc77ac91a601 => generated 1522 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:01:49.271079 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-7547fcc1-e0a7-4e8b-9313-7cc4cd9caeab tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:01:49.272014 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-7547fcc1-e0a7-4e8b-9313-7cc4cd9caeab tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] [instance: d40a3e67-031a-4ad7-bd79-7c7d9a3bece9] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:01:49.294049 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-7547fcc1-e0a7-4e8b-9313-7cc4cd9caeab tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:49.297841 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-7547fcc1-e0a7-4e8b-9313-7cc4cd9caeab tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:49.298765 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-7547fcc1-e0a7-4e8b-9313-7cc4cd9caeab tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:49.299770 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-7547fcc1-e0a7-4e8b-9313-7cc4cd9caeab tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:49.357688 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-2fc27d2a-5703-4f41-9b04-44338ff45251 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:01:49.359027 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-2fc27d2a-5703-4f41-9b04-44338ff45251 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] [instance: 5cfd118b-cc42-4dbe-93f1-784454892318] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:01:49.367475 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-2fc27d2a-5703-4f41-9b04-44338ff45251 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:49.368253 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-2fc27d2a-5703-4f41-9b04-44338ff45251 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:49.369764 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-2fc27d2a-5703-4f41-9b04-44338ff45251 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:49.370343 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-2fc27d2a-5703-4f41-9b04-44338ff45251 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:49.614575 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-7547fcc1-e0a7-4e8b-9313-7cc4cd9caeab tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a6c4623c5f471b8241257180b64d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2300d78ad8244e3be17c1f388603de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:49.624516 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-7547fcc1-e0a7-4e8b-9313-7cc4cd9caeab tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] 10.222.0.17 "GET /compute/v2.1/servers/d40a3e67-031a-4ad7-bd79-7c7d9a3bece9" status: 200 len: 1551 microversion: 2.1 time: 0.359719 Jun 16 23:01:49.627818 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 92/190] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:01:49 2022] GET /compute/v2.1/servers/d40a3e67-031a-4ad7-bd79-7c7d9a3bece9 => generated 1551 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:01:49.698822 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-2fc27d2a-5703-4f41-9b04-44338ff45251 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3a2d16133b4af8a208682de8a7d111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0526c12e8bc947209e24daf5ddfad7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:49.723457 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-2fc27d2a-5703-4f41-9b04-44338ff45251 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] 10.222.0.17 "GET /compute/v2.1/servers/5cfd118b-cc42-4dbe-93f1-784454892318" status: 200 len: 1367 microversion: 2.1 time: 0.367971 Jun 16 23:01:49.729396 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 99/191] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:01:49 2022] GET /compute/v2.1/servers/5cfd118b-cc42-4dbe-93f1-784454892318 => generated 1367 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:01:49.940697 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-6824faef-4e00-4aa3-a574-e5b8d40b2d2e tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:01:49.941440 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-6824faef-4e00-4aa3-a574-e5b8d40b2d2e tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] [instance: c2b8ba99-d845-4fca-b9e7-fc77ac91a601] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:01:49.954418 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-6824faef-4e00-4aa3-a574-e5b8d40b2d2e tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:49.954919 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-6824faef-4e00-4aa3-a574-e5b8d40b2d2e tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:49.956916 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-6824faef-4e00-4aa3-a574-e5b8d40b2d2e tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:49.957376 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-6824faef-4e00-4aa3-a574-e5b8d40b2d2e tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:50.161120 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-6824faef-4e00-4aa3-a574-e5b8d40b2d2e tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '243e592fbf1844d89f55dd5035a684f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60447df5461141e883d207e028b74bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:50.171541 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-6824faef-4e00-4aa3-a574-e5b8d40b2d2e tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] 10.222.0.17 "GET /compute/v2.1/servers/c2b8ba99-d845-4fca-b9e7-fc77ac91a601" status: 200 len: 1522 microversion: 2.1 time: 0.236039 Jun 16 23:01:50.172362 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 93/192] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:01:49 2022] GET /compute/v2.1/servers/c2b8ba99-d845-4fca-b9e7-fc77ac91a601 => generated 1522 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:01:50.366649 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [req-08d047fb-6cb8-4591-af58-ce4fc8e5d562 req-0c134999-5d10-48bc-a97b-d44b2e7be04a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d40a3e67-031a-4ad7-bd79-7c7d9a3bece9", "name": "network-vif-deleted", "tag": "d15996c2-23a1-4c1b-834d-20bf7a7f63af"}]} {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 23:01:50.386090 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [req-08d047fb-6cb8-4591-af58-ce4fc8e5d562 req-0c134999-5d10-48bc-a97b-d44b2e7be04a service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:50.386927 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [req-08d047fb-6cb8-4591-af58-ce4fc8e5d562 req-0c134999-5d10-48bc-a97b-d44b2e7be04a service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:50.402966 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.compute.server_external_events [req-08d047fb-6cb8-4591-af58-ce4fc8e5d562 req-0c134999-5d10-48bc-a97b-d44b2e7be04a service nova] Creating event network-vif-deleted:d15996c2-23a1-4c1b-834d-20bf7a7f63af for instance d40a3e67-031a-4ad7-bd79-7c7d9a3bece9 on hv-cinder-84623 Jun 16 23:01:50.409038 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [req-08d047fb-6cb8-4591-af58-ce4fc8e5d562 req-0c134999-5d10-48bc-a97b-d44b2e7be04a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048301 Jun 16 23:01:50.410459 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 100/193] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 23:01:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 23:01:50.644454 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-92fee865-567e-4c50-b2aa-ca6cd1c5cdb6 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:01:50.646369 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-92fee865-567e-4c50-b2aa-ca6cd1c5cdb6 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] [instance: d40a3e67-031a-4ad7-bd79-7c7d9a3bece9] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:01:50.653688 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-92fee865-567e-4c50-b2aa-ca6cd1c5cdb6 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:50.654433 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-92fee865-567e-4c50-b2aa-ca6cd1c5cdb6 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:50.655783 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-92fee865-567e-4c50-b2aa-ca6cd1c5cdb6 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:50.657029 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-92fee865-567e-4c50-b2aa-ca6cd1c5cdb6 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:50.740764 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-92fee865-567e-4c50-b2aa-ca6cd1c5cdb6 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4a6c4623c5f471b8241257180b64d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2300d78ad8244e3be17c1f388603de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:50.747610 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-5a522657-0cff-47dd-aefa-0d7127a06aa1 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:01:50.749460 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-5a522657-0cff-47dd-aefa-0d7127a06aa1 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] [instance: 5cfd118b-cc42-4dbe-93f1-784454892318] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:01:50.751155 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-92fee865-567e-4c50-b2aa-ca6cd1c5cdb6 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] 10.222.0.17 "GET /compute/v2.1/servers/d40a3e67-031a-4ad7-bd79-7c7d9a3bece9" status: 200 len: 1345 microversion: 2.1 time: 0.110599 Jun 16 23:01:50.752110 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 94/194] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:01:50 2022] GET /compute/v2.1/servers/d40a3e67-031a-4ad7-bd79-7c7d9a3bece9 => generated 1345 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:01:50.768043 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-5a522657-0cff-47dd-aefa-0d7127a06aa1 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:50.768754 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-5a522657-0cff-47dd-aefa-0d7127a06aa1 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:50.769589 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-5a522657-0cff-47dd-aefa-0d7127a06aa1 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:50.770029 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-5a522657-0cff-47dd-aefa-0d7127a06aa1 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:50.933641 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-5a522657-0cff-47dd-aefa-0d7127a06aa1 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3a2d16133b4af8a208682de8a7d111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0526c12e8bc947209e24daf5ddfad7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:50.942674 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-5a522657-0cff-47dd-aefa-0d7127a06aa1 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] 10.222.0.17 "GET /compute/v2.1/servers/5cfd118b-cc42-4dbe-93f1-784454892318" status: 200 len: 1556 microversion: 2.1 time: 0.205063 Jun 16 23:01:50.947174 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 101/195] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:01:50 2022] GET /compute/v2.1/servers/5cfd118b-cc42-4dbe-93f1-784454892318 => generated 1556 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:01:50.965422 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-ff0177c0-a4dd-464d-8e79-789c05d24774 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:01:50.966273 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-ff0177c0-a4dd-464d-8e79-789c05d24774 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] [instance: 5cfd118b-cc42-4dbe-93f1-784454892318] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:01:50.975424 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-ff0177c0-a4dd-464d-8e79-789c05d24774 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:50.977885 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-ff0177c0-a4dd-464d-8e79-789c05d24774 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:50.979557 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-ff0177c0-a4dd-464d-8e79-789c05d24774 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:50.983398 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-ff0177c0-a4dd-464d-8e79-789c05d24774 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:51.079715 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-ff0177c0-a4dd-464d-8e79-789c05d24774 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] 10.222.0.17 "GET /compute/v2.1/servers/5cfd118b-cc42-4dbe-93f1-784454892318/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.118382 Jun 16 23:01:51.085908 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 95/196] 10.222.0.17 () {58 vars in 1274 bytes} [Thu Jun 16 23:01:50 2022] GET /compute/v2.1/servers/5cfd118b-cc42-4dbe-93f1-784454892318/os-interface => generated 284 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 23:01:51.196855 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-3eaa6c84-7ca7-42ea-8f5d-e0603a23ff81 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:01:51.198022 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-3eaa6c84-7ca7-42ea-8f5d-e0603a23ff81 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] [instance: c2b8ba99-d845-4fca-b9e7-fc77ac91a601] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:01:51.205933 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-3eaa6c84-7ca7-42ea-8f5d-e0603a23ff81 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:51.206566 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-3eaa6c84-7ca7-42ea-8f5d-e0603a23ff81 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:51.207549 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-3eaa6c84-7ca7-42ea-8f5d-e0603a23ff81 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:51.208212 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-3eaa6c84-7ca7-42ea-8f5d-e0603a23ff81 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:51.471281 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-3eaa6c84-7ca7-42ea-8f5d-e0603a23ff81 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '243e592fbf1844d89f55dd5035a684f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60447df5461141e883d207e028b74bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:51.480743 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-3eaa6c84-7ca7-42ea-8f5d-e0603a23ff81 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] 10.222.0.17 "GET /compute/v2.1/servers/c2b8ba99-d845-4fca-b9e7-fc77ac91a601" status: 200 len: 1522 microversion: 2.1 time: 0.295600 Jun 16 23:01:51.481410 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 102/197] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:01:51 2022] GET /compute/v2.1/servers/c2b8ba99-d845-4fca-b9e7-fc77ac91a601 => generated 1522 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:01:51.773187 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-15a64a39-9f48-4afb-b7e0-f832ed342c9f tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:01:51.774462 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-15a64a39-9f48-4afb-b7e0-f832ed342c9f tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] [instance: d40a3e67-031a-4ad7-bd79-7c7d9a3bece9] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:01:51.785114 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-15a64a39-9f48-4afb-b7e0-f832ed342c9f tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:51.786040 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-15a64a39-9f48-4afb-b7e0-f832ed342c9f tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:51.787268 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-15a64a39-9f48-4afb-b7e0-f832ed342c9f tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:51.788489 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-15a64a39-9f48-4afb-b7e0-f832ed342c9f tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:51.812048 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.wsgi [None req-15a64a39-9f48-4afb-b7e0-f832ed342c9f tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] HTTP exception thrown: Instance d40a3e67-031a-4ad7-bd79-7c7d9a3bece9 could not be found. Jun 16 23:01:51.819072 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-15a64a39-9f48-4afb-b7e0-f832ed342c9f tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Request method failure captured: Jun 16 23:01:51.819072 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: request: GET /compute/v2.1/servers/d40a3e67-031a-4ad7-bd79-7c7d9a3bece9 HTTP/1.1 Jun 16 23:01:51.819072 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Accept: application/json Jun 16 23:01:51.819072 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Accept-Encoding: identity Jun 16 23:01:51.819072 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Connection: close Jun 16 23:01:51.819072 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Content-Length: 0 Jun 16 23:01:51.819072 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Content-Type: application/json Jun 16 23:01:51.819072 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Host: 10.222.0.17 Jun 16 23:01:51.819072 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Openstack-System-Scope: None Jun 16 23:01:51.819072 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: User-Agent: python-urllib3/1.26.9 Jun 16 23:01:51.819072 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Auth-Token: gAAAAABiq7YXxcOjoV8QYd-c56Ylv3oO1do13mYg4gc92SD1bCZQzJie4YzIPVnroGanLgn9cVGJIA-BjvW0KvAqjYBgqEaQkWSOBYcMVV7skCVHKNkgX4dBnsDOfs52g6-HwfkMAaO-gqH6NWKibEbztO5WBDg_6r-aFFHyxqMmto5dSTDTX6w Jun 16 23:01:51.819072 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Domain-Id: None Jun 16 23:01:51.819072 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Domain-Name: None Jun 16 23:01:51.819072 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Identity-Status: Confirmed Jun 16 23:01:51.819072 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Is-Admin-Project: True Jun 16 23:01:51.819072 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Project-Domain-Id: default Jun 16 23:01:51.819072 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Project-Domain-Name: Default Jun 16 23:01:51.819072 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Project-Id: c2300d78ad8244e3be17c1f388603de7 Jun 16 23:01:51.819072 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Project-Name: tempest-DeleteServersTestJSON-1536820524 Jun 16 23:01:51.819072 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Role: member,reader Jun 16 23:01:51.819072 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Roles: member,reader Jun 16 23:01:51.820400 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/c2300d78ad8244e3be17c1f388603de7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_c2300d78ad8244e3be17c1f388603de7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c2300d78ad8244e3be17c1f388603de7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c2300d78ad8244e3be17c1f388603de7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Jun 16 23:01:51.820400 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Tenant: tempest-DeleteServersTestJSON-1536820524 Jun 16 23:01:51.820400 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Tenant-Id: c2300d78ad8244e3be17c1f388603de7 Jun 16 23:01:51.820400 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Tenant-Name: tempest-DeleteServersTestJSON-1536820524 Jun 16 23:01:51.820400 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-User: tempest-DeleteServersTestJSON-1536820524-project Jun 16 23:01:51.820400 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-User-Domain-Id: default Jun 16 23:01:51.820400 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-User-Domain-Name: Default Jun 16 23:01:51.820400 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-User-Id: a4a6c4623c5f471b8241257180b64d37 Jun 16 23:01:51.820400 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-User-Name: tempest-DeleteServersTestJSON-1536820524-project Jun 16 23:01:51.820400 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: method: > Jun 16 23:01:51.820400 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: exception: Instance d40a3e67-031a-4ad7-bd79-7c7d9a3bece9 could not be found. Jun 16 23:01:51.820400 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: action_args: {'id': 'd40a3e67-031a-4ad7-bd79-7c7d9a3bece9'} Jun 16 23:01:51.821248 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 23:01:51.821248 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 23:01:51.821248 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 23:01:51.821248 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 23:01:51.821248 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 23:01:51.821248 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 23:01:51.821248 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 23:01:51.821248 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 23:01:51.821248 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 23:01:51.821248 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 23:01:51.821248 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d40a3e67-031a-4ad7-bd79-7c7d9a3bece9 could not be found. Jun 16 23:01:51.821248 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 16 23:01:51.821248 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 23:01:51.821248 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 16 23:01:51.821248 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 23:01:51.821248 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 23:01:51.821248 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 23:01:51.821248 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 23:01:51.821248 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 23:01:51.821248 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 23:01:51.822444 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 23:01:51.822444 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 23:01:51.822444 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 23:01:51.822444 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 23:01:51.822444 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 23:01:51.822444 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 23:01:51.822444 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 23:01:51.822444 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d40a3e67-031a-4ad7-bd79-7c7d9a3bece9 could not be found. Jun 16 23:01:51.822444 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 16 23:01:51.822444 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 23:01:51.822444 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 16 23:01:51.822444 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 23:01:51.822444 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 23:01:51.822444 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 23:01:51.822444 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 23:01:51.822444 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 23:01:51.822444 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d40a3e67-031a-4ad7-bd79-7c7d9a3bece9 could not be found. Jun 16 23:01:51.822444 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 16 23:01:51.823442 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-15a64a39-9f48-4afb-b7e0-f832ed342c9f tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Returning 404 to user: Instance d40a3e67-031a-4ad7-bd79-7c7d9a3bece9 could not be found. {{(pid=117563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 23:01:51.823442 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-15a64a39-9f48-4afb-b7e0-f832ed342c9f tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] 10.222.0.17 "GET /compute/v2.1/servers/d40a3e67-031a-4ad7-bd79-7c7d9a3bece9" status: 404 len: 111 microversion: 2.1 time: 0.054173 Jun 16 23:01:51.823442 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 96/198] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:01:51 2022] GET /compute/v2.1/servers/d40a3e67-031a-4ad7-bd79-7c7d9a3bece9 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 23:01:51.955644 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-112494a6-2382-42ad-90fe-ae439eb00ce3 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:01:51.957366 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-112494a6-2382-42ad-90fe-ae439eb00ce3 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] [instance: d40a3e67-031a-4ad7-bd79-7c7d9a3bece9] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:01:51.967691 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-112494a6-2382-42ad-90fe-ae439eb00ce3 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:51.968600 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-112494a6-2382-42ad-90fe-ae439eb00ce3 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:51.971139 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-112494a6-2382-42ad-90fe-ae439eb00ce3 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:51.972219 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-112494a6-2382-42ad-90fe-ae439eb00ce3 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:51.999478 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.wsgi [None req-112494a6-2382-42ad-90fe-ae439eb00ce3 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] HTTP exception thrown: Instance d40a3e67-031a-4ad7-bd79-7c7d9a3bece9 could not be found. Jun 16 23:01:52.009272 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-112494a6-2382-42ad-90fe-ae439eb00ce3 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Request method failure captured: Jun 16 23:01:52.009272 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: request: GET /compute/v2.1/servers/d40a3e67-031a-4ad7-bd79-7c7d9a3bece9/os-volume_attachments HTTP/1.1 Jun 16 23:01:52.009272 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Accept: application/json Jun 16 23:01:52.009272 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Accept-Encoding: identity Jun 16 23:01:52.009272 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Connection: close Jun 16 23:01:52.009272 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Content-Length: 0 Jun 16 23:01:52.009272 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Content-Type: application/json Jun 16 23:01:52.009272 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Host: 10.222.0.17 Jun 16 23:01:52.009272 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Openstack-System-Scope: None Jun 16 23:01:52.009272 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: User-Agent: python-urllib3/1.26.9 Jun 16 23:01:52.009272 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Auth-Token: gAAAAABiq7YXxcOjoV8QYd-c56Ylv3oO1do13mYg4gc92SD1bCZQzJie4YzIPVnroGanLgn9cVGJIA-BjvW0KvAqjYBgqEaQkWSOBYcMVV7skCVHKNkgX4dBnsDOfs52g6-HwfkMAaO-gqH6NWKibEbztO5WBDg_6r-aFFHyxqMmto5dSTDTX6w Jun 16 23:01:52.009272 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Domain-Id: None Jun 16 23:01:52.009272 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Domain-Name: None Jun 16 23:01:52.009272 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Identity-Status: Confirmed Jun 16 23:01:52.009272 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Is-Admin-Project: True Jun 16 23:01:52.009272 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Project-Domain-Id: default Jun 16 23:01:52.009272 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Project-Domain-Name: Default Jun 16 23:01:52.009272 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Project-Id: c2300d78ad8244e3be17c1f388603de7 Jun 16 23:01:52.009272 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Project-Name: tempest-DeleteServersTestJSON-1536820524 Jun 16 23:01:52.009272 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Role: member,reader Jun 16 23:01:52.009272 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Roles: member,reader Jun 16 23:01:52.011686 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/c2300d78ad8244e3be17c1f388603de7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_c2300d78ad8244e3be17c1f388603de7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c2300d78ad8244e3be17c1f388603de7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c2300d78ad8244e3be17c1f388603de7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Jun 16 23:01:52.011686 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Tenant: tempest-DeleteServersTestJSON-1536820524 Jun 16 23:01:52.011686 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Tenant-Id: c2300d78ad8244e3be17c1f388603de7 Jun 16 23:01:52.011686 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Tenant-Name: tempest-DeleteServersTestJSON-1536820524 Jun 16 23:01:52.011686 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-User: tempest-DeleteServersTestJSON-1536820524-project Jun 16 23:01:52.011686 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-User-Domain-Id: default Jun 16 23:01:52.011686 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-User-Domain-Name: Default Jun 16 23:01:52.011686 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-User-Id: a4a6c4623c5f471b8241257180b64d37 Jun 16 23:01:52.011686 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-User-Name: tempest-DeleteServersTestJSON-1536820524-project Jun 16 23:01:52.011686 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: method: > Jun 16 23:01:52.011686 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: exception: Instance d40a3e67-031a-4ad7-bd79-7c7d9a3bece9 could not be found. Jun 16 23:01:52.011686 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: action_args: {'server_id': 'd40a3e67-031a-4ad7-bd79-7c7d9a3bece9'} Jun 16 23:01:52.013004 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 23:01:52.013004 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 23:01:52.013004 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 23:01:52.013004 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 23:01:52.013004 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 23:01:52.013004 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 23:01:52.013004 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 23:01:52.013004 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 23:01:52.013004 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 23:01:52.013004 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 23:01:52.013004 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d40a3e67-031a-4ad7-bd79-7c7d9a3bece9 could not be found. Jun 16 23:01:52.013004 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Jun 16 23:01:52.013004 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 23:01:52.013004 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Jun 16 23:01:52.013004 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 23:01:52.013004 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 23:01:52.013004 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 23:01:52.013004 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 23:01:52.013004 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 23:01:52.013004 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 23:01:52.017424 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 23:01:52.017424 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 16 23:01:52.017424 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 23:01:52.017424 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 16 23:01:52.017424 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 23:01:52.017424 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jun 16 23:01:52.017424 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jun 16 23:01:52.017424 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 23:01:52.017424 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 23:01:52.017424 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d40a3e67-031a-4ad7-bd79-7c7d9a3bece9 could not be found. Jun 16 23:01:52.017424 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Jun 16 23:01:52.017424 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 23:01:52.017424 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Jun 16 23:01:52.017424 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 23:01:52.017424 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 23:01:52.017424 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 23:01:52.017424 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 23:01:52.017424 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 23:01:52.017424 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d40a3e67-031a-4ad7-bd79-7c7d9a3bece9 could not be found. Jun 16 23:01:52.017424 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Jun 16 23:01:52.024005 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-112494a6-2382-42ad-90fe-ae439eb00ce3 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Returning 404 to user: Instance d40a3e67-031a-4ad7-bd79-7c7d9a3bece9 could not be found. {{(pid=117562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 23:01:52.025159 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-112494a6-2382-42ad-90fe-ae439eb00ce3 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] 10.222.0.17 "GET /compute/v2.1/servers/d40a3e67-031a-4ad7-bd79-7c7d9a3bece9/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.075094 Jun 16 23:01:52.026921 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 103/199] 10.222.0.17 () {58 vars in 1301 bytes} [Thu Jun 16 23:01:51 2022] GET /compute/v2.1/servers/d40a3e67-031a-4ad7-bd79-7c7d9a3bece9/os-volume_attachments => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 23:01:52.444713 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [req-5c4ffe00-87b6-49aa-945e-d49654f69718 req-2556f58a-d204-471c-af02-b6208e9f7959 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46f43909-d681-4938-8253-5080b626e169", "tag": "42e82895-598b-468f-aac2-e51ebe9d9946"}]} {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 23:01:52.466911 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-5c4ffe00-87b6-49aa-945e-d49654f69718 req-2556f58a-d204-471c-af02-b6208e9f7959 service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:52.468197 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-5c4ffe00-87b6-49aa-945e-d49654f69718 req-2556f58a-d204-471c-af02-b6208e9f7959 service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:52.489612 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.compute.server_external_events [req-5c4ffe00-87b6-49aa-945e-d49654f69718 req-2556f58a-d204-471c-af02-b6208e9f7959 service nova] Creating event network-changed:42e82895-598b-468f-aac2-e51ebe9d9946 for instance 46f43909-d681-4938-8253-5080b626e169 on hv-cinder-84623 Jun 16 23:01:52.497307 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-38b89e2a-248f-4e51-83af-368681286b2f tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:01:52.498696 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-38b89e2a-248f-4e51-83af-368681286b2f tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] [instance: c2b8ba99-d845-4fca-b9e7-fc77ac91a601] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:01:52.502094 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG dbcounter [-] [117562] Writing DB stats nova_api:SELECT=100 {{(pid=117562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 23:01:52.506061 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [req-5c4ffe00-87b6-49aa-945e-d49654f69718 req-2556f58a-d204-471c-af02-b6208e9f7959 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064899 Jun 16 23:01:52.507003 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 97/200] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 23:01:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 23:01:52.508166 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-38b89e2a-248f-4e51-83af-368681286b2f tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:52.509024 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-38b89e2a-248f-4e51-83af-368681286b2f tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:52.510006 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-38b89e2a-248f-4e51-83af-368681286b2f tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:52.510749 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-38b89e2a-248f-4e51-83af-368681286b2f tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:52.850398 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-38b89e2a-248f-4e51-83af-368681286b2f tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '243e592fbf1844d89f55dd5035a684f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60447df5461141e883d207e028b74bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:52.860751 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-38b89e2a-248f-4e51-83af-368681286b2f tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] 10.222.0.17 "GET /compute/v2.1/servers/c2b8ba99-d845-4fca-b9e7-fc77ac91a601" status: 200 len: 1522 microversion: 2.1 time: 0.367256 Jun 16 23:01:52.861510 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 104/201] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:01:52 2022] GET /compute/v2.1/servers/c2b8ba99-d845-4fca-b9e7-fc77ac91a601 => generated 1522 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 23:01:53.345954 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-f546aa94-bd3a-431b-9415-d55e1811062e tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:01:53.347271 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-f546aa94-bd3a-431b-9415-d55e1811062e tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] [instance: d40a3e67-031a-4ad7-bd79-7c7d9a3bece9] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:01:53.358261 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-f546aa94-bd3a-431b-9415-d55e1811062e tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:53.358745 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-f546aa94-bd3a-431b-9415-d55e1811062e tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:53.359531 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-f546aa94-bd3a-431b-9415-d55e1811062e tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:53.359968 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-f546aa94-bd3a-431b-9415-d55e1811062e tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:53.399407 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.wsgi [None req-f546aa94-bd3a-431b-9415-d55e1811062e tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] HTTP exception thrown: Instance d40a3e67-031a-4ad7-bd79-7c7d9a3bece9 could not be found. Jun 16 23:01:53.406290 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-f546aa94-bd3a-431b-9415-d55e1811062e tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Request method failure captured: Jun 16 23:01:53.406290 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: request: DELETE /compute/v2.1/servers/d40a3e67-031a-4ad7-bd79-7c7d9a3bece9 HTTP/1.1 Jun 16 23:01:53.406290 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Accept: application/json Jun 16 23:01:53.406290 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Accept-Encoding: identity Jun 16 23:01:53.406290 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Connection: close Jun 16 23:01:53.406290 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Content-Length: 0 Jun 16 23:01:53.406290 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Content-Type: application/json Jun 16 23:01:53.406290 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Host: 10.222.0.17 Jun 16 23:01:53.406290 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Openstack-System-Scope: None Jun 16 23:01:53.406290 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: User-Agent: python-urllib3/1.26.9 Jun 16 23:01:53.406290 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Auth-Token: gAAAAABiq7YXxcOjoV8QYd-c56Ylv3oO1do13mYg4gc92SD1bCZQzJie4YzIPVnroGanLgn9cVGJIA-BjvW0KvAqjYBgqEaQkWSOBYcMVV7skCVHKNkgX4dBnsDOfs52g6-HwfkMAaO-gqH6NWKibEbztO5WBDg_6r-aFFHyxqMmto5dSTDTX6w Jun 16 23:01:53.406290 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Domain-Id: None Jun 16 23:01:53.406290 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Domain-Name: None Jun 16 23:01:53.406290 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Identity-Status: Confirmed Jun 16 23:01:53.406290 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Is-Admin-Project: True Jun 16 23:01:53.406290 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Project-Domain-Id: default Jun 16 23:01:53.406290 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Project-Domain-Name: Default Jun 16 23:01:53.406290 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Project-Id: c2300d78ad8244e3be17c1f388603de7 Jun 16 23:01:53.406290 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Project-Name: tempest-DeleteServersTestJSON-1536820524 Jun 16 23:01:53.406290 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Role: member,reader Jun 16 23:01:53.406290 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Roles: member,reader Jun 16 23:01:53.407533 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/c2300d78ad8244e3be17c1f388603de7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_c2300d78ad8244e3be17c1f388603de7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c2300d78ad8244e3be17c1f388603de7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c2300d78ad8244e3be17c1f388603de7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Jun 16 23:01:53.407533 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Tenant: tempest-DeleteServersTestJSON-1536820524 Jun 16 23:01:53.407533 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Tenant-Id: c2300d78ad8244e3be17c1f388603de7 Jun 16 23:01:53.407533 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Tenant-Name: tempest-DeleteServersTestJSON-1536820524 Jun 16 23:01:53.407533 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-User: tempest-DeleteServersTestJSON-1536820524-project Jun 16 23:01:53.407533 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-User-Domain-Id: default Jun 16 23:01:53.407533 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-User-Domain-Name: Default Jun 16 23:01:53.407533 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-User-Id: a4a6c4623c5f471b8241257180b64d37 Jun 16 23:01:53.407533 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-User-Name: tempest-DeleteServersTestJSON-1536820524-project Jun 16 23:01:53.407533 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: method: > Jun 16 23:01:53.407533 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: exception: Instance d40a3e67-031a-4ad7-bd79-7c7d9a3bece9 could not be found. Jun 16 23:01:53.407533 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: action_args: {'id': 'd40a3e67-031a-4ad7-bd79-7c7d9a3bece9'} Jun 16 23:01:53.408194 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 23:01:53.408194 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 23:01:53.408194 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 23:01:53.408194 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 23:01:53.408194 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 23:01:53.408194 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 23:01:53.408194 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 23:01:53.408194 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 23:01:53.408194 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 23:01:53.408194 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 23:01:53.408194 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d40a3e67-031a-4ad7-bd79-7c7d9a3bece9 could not be found. Jun 16 23:01:53.408194 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 16 23:01:53.408194 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 23:01:53.408194 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 16 23:01:53.408194 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 23:01:53.408194 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 23:01:53.408194 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 23:01:53.408194 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 23:01:53.408194 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 23:01:53.408194 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 23:01:53.409214 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 23:01:53.409214 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 23:01:53.409214 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 23:01:53.409214 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 23:01:53.409214 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 23:01:53.409214 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 23:01:53.409214 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 23:01:53.409214 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 23:01:53.409214 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 23:01:53.409214 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d40a3e67-031a-4ad7-bd79-7c7d9a3bece9 could not be found. Jun 16 23:01:53.409214 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 16 23:01:53.409214 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 23:01:53.409214 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 16 23:01:53.409214 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 23:01:53.409214 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 23:01:53.409214 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 23:01:53.409214 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 23:01:53.409214 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 23:01:53.409214 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d40a3e67-031a-4ad7-bd79-7c7d9a3bece9 could not be found. Jun 16 23:01:53.409214 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 16 23:01:53.411942 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-f546aa94-bd3a-431b-9415-d55e1811062e tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Returning 404 to user: Instance d40a3e67-031a-4ad7-bd79-7c7d9a3bece9 could not be found. {{(pid=117563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 23:01:53.412969 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-f546aa94-bd3a-431b-9415-d55e1811062e tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] 10.222.0.17 "DELETE /compute/v2.1/servers/d40a3e67-031a-4ad7-bd79-7c7d9a3bece9" status: 404 len: 111 microversion: 2.1 time: 0.071993 Jun 16 23:01:53.415169 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 98/202] 10.222.0.17 () {58 vars in 1238 bytes} [Thu Jun 16 23:01:53 2022] DELETE /compute/v2.1/servers/d40a3e67-031a-4ad7-bd79-7c7d9a3bece9 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 23:01:53.424597 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-dfa35e21-52e1-46ac-9bc6-48b91258df17 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:01:53.425416 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-dfa35e21-52e1-46ac-9bc6-48b91258df17 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] [instance: d40a3e67-031a-4ad7-bd79-7c7d9a3bece9] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:01:53.439919 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-dfa35e21-52e1-46ac-9bc6-48b91258df17 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:53.440368 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-dfa35e21-52e1-46ac-9bc6-48b91258df17 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:53.441158 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-dfa35e21-52e1-46ac-9bc6-48b91258df17 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:53.441588 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-dfa35e21-52e1-46ac-9bc6-48b91258df17 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:53.468800 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.wsgi [None req-dfa35e21-52e1-46ac-9bc6-48b91258df17 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] HTTP exception thrown: Instance d40a3e67-031a-4ad7-bd79-7c7d9a3bece9 could not be found. Jun 16 23:01:53.470973 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-dfa35e21-52e1-46ac-9bc6-48b91258df17 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Request method failure captured: Jun 16 23:01:53.470973 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: request: GET /compute/v2.1/servers/d40a3e67-031a-4ad7-bd79-7c7d9a3bece9 HTTP/1.1 Jun 16 23:01:53.470973 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Accept: application/json Jun 16 23:01:53.470973 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Accept-Encoding: identity Jun 16 23:01:53.470973 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Connection: close Jun 16 23:01:53.470973 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Content-Length: 0 Jun 16 23:01:53.470973 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Content-Type: application/json Jun 16 23:01:53.470973 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Host: 10.222.0.17 Jun 16 23:01:53.470973 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Openstack-System-Scope: None Jun 16 23:01:53.470973 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: User-Agent: python-urllib3/1.26.9 Jun 16 23:01:53.470973 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Auth-Token: gAAAAABiq7YXxcOjoV8QYd-c56Ylv3oO1do13mYg4gc92SD1bCZQzJie4YzIPVnroGanLgn9cVGJIA-BjvW0KvAqjYBgqEaQkWSOBYcMVV7skCVHKNkgX4dBnsDOfs52g6-HwfkMAaO-gqH6NWKibEbztO5WBDg_6r-aFFHyxqMmto5dSTDTX6w Jun 16 23:01:53.470973 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Domain-Id: None Jun 16 23:01:53.470973 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Domain-Name: None Jun 16 23:01:53.470973 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Identity-Status: Confirmed Jun 16 23:01:53.470973 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Is-Admin-Project: True Jun 16 23:01:53.470973 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Project-Domain-Id: default Jun 16 23:01:53.470973 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Project-Domain-Name: Default Jun 16 23:01:53.470973 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Project-Id: c2300d78ad8244e3be17c1f388603de7 Jun 16 23:01:53.470973 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Project-Name: tempest-DeleteServersTestJSON-1536820524 Jun 16 23:01:53.470973 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Role: member,reader Jun 16 23:01:53.470973 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Roles: member,reader Jun 16 23:01:53.472155 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/c2300d78ad8244e3be17c1f388603de7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_c2300d78ad8244e3be17c1f388603de7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c2300d78ad8244e3be17c1f388603de7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c2300d78ad8244e3be17c1f388603de7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Jun 16 23:01:53.472155 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Tenant: tempest-DeleteServersTestJSON-1536820524 Jun 16 23:01:53.472155 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Tenant-Id: c2300d78ad8244e3be17c1f388603de7 Jun 16 23:01:53.472155 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Tenant-Name: tempest-DeleteServersTestJSON-1536820524 Jun 16 23:01:53.472155 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-User: tempest-DeleteServersTestJSON-1536820524-project Jun 16 23:01:53.472155 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-User-Domain-Id: default Jun 16 23:01:53.472155 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-User-Domain-Name: Default Jun 16 23:01:53.472155 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-User-Id: a4a6c4623c5f471b8241257180b64d37 Jun 16 23:01:53.472155 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-User-Name: tempest-DeleteServersTestJSON-1536820524-project Jun 16 23:01:53.472155 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: method: > Jun 16 23:01:53.472155 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: exception: Instance d40a3e67-031a-4ad7-bd79-7c7d9a3bece9 could not be found. Jun 16 23:01:53.472155 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: action_args: {'id': 'd40a3e67-031a-4ad7-bd79-7c7d9a3bece9'} Jun 16 23:01:53.472838 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 23:01:53.472838 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 23:01:53.472838 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 23:01:53.472838 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 23:01:53.472838 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 23:01:53.472838 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 23:01:53.472838 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 23:01:53.472838 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 23:01:53.472838 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 23:01:53.472838 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 23:01:53.472838 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d40a3e67-031a-4ad7-bd79-7c7d9a3bece9 could not be found. Jun 16 23:01:53.472838 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Jun 16 23:01:53.472838 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 23:01:53.472838 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Jun 16 23:01:53.472838 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 23:01:53.472838 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 23:01:53.472838 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 23:01:53.472838 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 23:01:53.472838 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 23:01:53.472838 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 23:01:53.473922 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 23:01:53.473922 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 23:01:53.473922 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 23:01:53.473922 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 23:01:53.473922 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 23:01:53.473922 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 23:01:53.473922 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 23:01:53.473922 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d40a3e67-031a-4ad7-bd79-7c7d9a3bece9 could not be found. Jun 16 23:01:53.473922 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Jun 16 23:01:53.473922 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 23:01:53.473922 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Jun 16 23:01:53.473922 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 23:01:53.473922 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 23:01:53.473922 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 23:01:53.473922 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 23:01:53.473922 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 23:01:53.473922 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d40a3e67-031a-4ad7-bd79-7c7d9a3bece9 could not be found. Jun 16 23:01:53.473922 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Jun 16 23:01:53.474907 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-dfa35e21-52e1-46ac-9bc6-48b91258df17 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] Returning 404 to user: Instance d40a3e67-031a-4ad7-bd79-7c7d9a3bece9 could not be found. {{(pid=117562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 23:01:53.474907 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-dfa35e21-52e1-46ac-9bc6-48b91258df17 tempest-DeleteServersTestJSON-1536820524 tempest-DeleteServersTestJSON-1536820524-project] 10.222.0.17 "GET /compute/v2.1/servers/d40a3e67-031a-4ad7-bd79-7c7d9a3bece9" status: 404 len: 111 microversion: 2.1 time: 0.052756 Jun 16 23:01:53.474907 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 105/203] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:01:53 2022] GET /compute/v2.1/servers/d40a3e67-031a-4ad7-bd79-7c7d9a3bece9 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 23:01:53.879224 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-5553f281-3d5a-4e64-8db0-eff6fd294227 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:01:53.879891 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-5553f281-3d5a-4e64-8db0-eff6fd294227 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] [instance: c2b8ba99-d845-4fca-b9e7-fc77ac91a601] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:01:53.892289 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-5553f281-3d5a-4e64-8db0-eff6fd294227 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:53.893002 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-5553f281-3d5a-4e64-8db0-eff6fd294227 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:53.895968 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-5553f281-3d5a-4e64-8db0-eff6fd294227 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:53.896593 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-5553f281-3d5a-4e64-8db0-eff6fd294227 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:54.206877 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-5553f281-3d5a-4e64-8db0-eff6fd294227 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '243e592fbf1844d89f55dd5035a684f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60447df5461141e883d207e028b74bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:54.221566 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-5553f281-3d5a-4e64-8db0-eff6fd294227 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] 10.222.0.17 "GET /compute/v2.1/servers/c2b8ba99-d845-4fca-b9e7-fc77ac91a601" status: 200 len: 1522 microversion: 2.1 time: 0.347073 Jun 16 23:01:54.231877 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 99/204] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:01:53 2022] GET /compute/v2.1/servers/c2b8ba99-d845-4fca-b9e7-fc77ac91a601 => generated 1522 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:01:54.892252 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [req-4fab8e08-10ff-413e-9161-0680a03ba7d8 req-09a7e5e3-b90f-40b3-8d79-5dc6931eba8c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5cfd118b-cc42-4dbe-93f1-784454892318", "tag": "cdc1a373-1b2c-4326-9d15-b3c2fc92a365"}]} {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 23:01:54.908665 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [req-4fab8e08-10ff-413e-9161-0680a03ba7d8 req-09a7e5e3-b90f-40b3-8d79-5dc6931eba8c service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:54.910766 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [req-4fab8e08-10ff-413e-9161-0680a03ba7d8 req-09a7e5e3-b90f-40b3-8d79-5dc6931eba8c service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:54.938415 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.compute.server_external_events [req-4fab8e08-10ff-413e-9161-0680a03ba7d8 req-09a7e5e3-b90f-40b3-8d79-5dc6931eba8c service nova] Creating event network-changed:cdc1a373-1b2c-4326-9d15-b3c2fc92a365 for instance 5cfd118b-cc42-4dbe-93f1-784454892318 on hv-cinder-84623 Jun 16 23:01:54.949186 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [req-4fab8e08-10ff-413e-9161-0680a03ba7d8 req-09a7e5e3-b90f-40b3-8d79-5dc6931eba8c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061461 Jun 16 23:01:54.951486 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 106/205] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 23:01:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 23:01:55.238856 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-f8cac627-2dfd-409c-b913-bda1425c5358 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:01:55.239928 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-f8cac627-2dfd-409c-b913-bda1425c5358 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] [instance: c2b8ba99-d845-4fca-b9e7-fc77ac91a601] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:01:55.267985 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-f8cac627-2dfd-409c-b913-bda1425c5358 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:55.268442 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-f8cac627-2dfd-409c-b913-bda1425c5358 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:55.269235 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-f8cac627-2dfd-409c-b913-bda1425c5358 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:55.269678 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-f8cac627-2dfd-409c-b913-bda1425c5358 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:55.687807 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-f8cac627-2dfd-409c-b913-bda1425c5358 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '243e592fbf1844d89f55dd5035a684f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60447df5461141e883d207e028b74bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:55.697925 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-f8cac627-2dfd-409c-b913-bda1425c5358 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] 10.222.0.17 "GET /compute/v2.1/servers/c2b8ba99-d845-4fca-b9e7-fc77ac91a601" status: 200 len: 1522 microversion: 2.1 time: 0.462915 Jun 16 23:01:55.707196 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 100/206] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:01:55 2022] GET /compute/v2.1/servers/c2b8ba99-d845-4fca-b9e7-fc77ac91a601 => generated 1522 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:01:56.714478 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-21173fd8-7863-45a6-98ff-de852c4df05c tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:01:56.715764 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-21173fd8-7863-45a6-98ff-de852c4df05c tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] [instance: c2b8ba99-d845-4fca-b9e7-fc77ac91a601] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:01:56.723843 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-21173fd8-7863-45a6-98ff-de852c4df05c tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:56.724500 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-21173fd8-7863-45a6-98ff-de852c4df05c tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:56.725427 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-21173fd8-7863-45a6-98ff-de852c4df05c tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:56.726015 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-21173fd8-7863-45a6-98ff-de852c4df05c tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:56.738499 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-f8fd8e73-05a1-4d23-a469-f1b905e82e68 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Action: 'create', calling method: .version_select at 0x7f532015fe50>, body: {"keypair": {"name": "tempest-TestShelveInstance-815840424", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFv9aAQmBm2J/+inaRNjeyzH12HnYYaJIYgE/3vtd2PoMwAJoctqt/LUx+6jJ3DwZHIpN3tA0seL4Cg5+LoXV8zIlouVGFIOiaKRdRHReKZOU0VLs8tVu9fTwsB6xNv/UQ=="}} {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 23:01:56.754400 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.quota [None req-f8fd8e73-05a1-4d23-a469-f1b905e82e68 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Getting quotas for project b30b90ec4d5e45468a4fa0fb98e46393. Resources: {'key_pairs'} {{(pid=117562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 23:01:56.761247 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.quota [None req-f8fd8e73-05a1-4d23-a469-f1b905e82e68 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Getting quotas for user 01dd0e5661f44d05a01d7a5e82dbadf3 and project b30b90ec4d5e45468a4fa0fb98e46393. Resources: {'key_pairs'} {{(pid=117562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 23:01:56.790090 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-f8fd8e73-05a1-4d23-a469-f1b905e82e68 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.292542 Jun 16 23:01:56.791344 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 107/207] 10.222.0.17 () {60 vars in 1158 bytes} [Thu Jun 16 23:01:56 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 23:01:56.927490 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-21173fd8-7863-45a6-98ff-de852c4df05c tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '243e592fbf1844d89f55dd5035a684f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60447df5461141e883d207e028b74bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:56.937342 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-21173fd8-7863-45a6-98ff-de852c4df05c tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] 10.222.0.17 "GET /compute/v2.1/servers/c2b8ba99-d845-4fca-b9e7-fc77ac91a601" status: 200 len: 1522 microversion: 2.1 time: 0.226404 Jun 16 23:01:56.947319 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 101/208] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:01:56 2022] GET /compute/v2.1/servers/c2b8ba99-d845-4fca-b9e7-fc77ac91a601 => generated 1522 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 23:01:57.956158 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-8365cadc-4e81-445b-b229-11f82881e8a2 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:01:57.956801 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-8365cadc-4e81-445b-b229-11f82881e8a2 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] [instance: c2b8ba99-d845-4fca-b9e7-fc77ac91a601] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:01:57.971778 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-8365cadc-4e81-445b-b229-11f82881e8a2 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:57.972386 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-8365cadc-4e81-445b-b229-11f82881e8a2 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:57.974665 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-8365cadc-4e81-445b-b229-11f82881e8a2 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:57.975382 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-8365cadc-4e81-445b-b229-11f82881e8a2 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:58.202484 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-8365cadc-4e81-445b-b229-11f82881e8a2 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '243e592fbf1844d89f55dd5035a684f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60447df5461141e883d207e028b74bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:58.217437 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-8365cadc-4e81-445b-b229-11f82881e8a2 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] 10.222.0.17 "GET /compute/v2.1/servers/c2b8ba99-d845-4fca-b9e7-fc77ac91a601" status: 200 len: 1522 microversion: 2.1 time: 0.267528 Jun 16 23:01:58.218020 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 108/209] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:01:57 2022] GET /compute/v2.1/servers/c2b8ba99-d845-4fca-b9e7-fc77ac91a601 => generated 1522 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:01:59.233508 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-04459380-3943-4fe5-a0e9-67651558cd14 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:01:59.235114 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-04459380-3943-4fe5-a0e9-67651558cd14 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] [instance: c2b8ba99-d845-4fca-b9e7-fc77ac91a601] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:01:59.245134 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-04459380-3943-4fe5-a0e9-67651558cd14 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:59.245532 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-04459380-3943-4fe5-a0e9-67651558cd14 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:59.246308 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-04459380-3943-4fe5-a0e9-67651558cd14 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:01:59.258905 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-04459380-3943-4fe5-a0e9-67651558cd14 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:01:59.668087 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-04459380-3943-4fe5-a0e9-67651558cd14 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '243e592fbf1844d89f55dd5035a684f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60447df5461141e883d207e028b74bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:01:59.697179 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-04459380-3943-4fe5-a0e9-67651558cd14 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] 10.222.0.17 "GET /compute/v2.1/servers/c2b8ba99-d845-4fca-b9e7-fc77ac91a601" status: 200 len: 1522 microversion: 2.1 time: 0.467390 Jun 16 23:01:59.699626 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 102/210] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:01:59 2022] GET /compute/v2.1/servers/c2b8ba99-d845-4fca-b9e7-fc77ac91a601 => generated 1522 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:02:00.727197 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-479bf253-812c-477a-9af3-2e505db3efde tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:02:00.727742 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-479bf253-812c-477a-9af3-2e505db3efde tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] [instance: c2b8ba99-d845-4fca-b9e7-fc77ac91a601] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:02:00.736719 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-479bf253-812c-477a-9af3-2e505db3efde tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:00.737178 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-479bf253-812c-477a-9af3-2e505db3efde tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:00.743448 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-479bf253-812c-477a-9af3-2e505db3efde tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:00.743926 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-479bf253-812c-477a-9af3-2e505db3efde tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:00.996297 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-479bf253-812c-477a-9af3-2e505db3efde tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '243e592fbf1844d89f55dd5035a684f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60447df5461141e883d207e028b74bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:02:01.005130 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-479bf253-812c-477a-9af3-2e505db3efde tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] 10.222.0.17 "GET /compute/v2.1/servers/c2b8ba99-d845-4fca-b9e7-fc77ac91a601" status: 200 len: 1522 microversion: 2.1 time: 0.292783 Jun 16 23:02:01.005587 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 109/211] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:02:00 2022] GET /compute/v2.1/servers/c2b8ba99-d845-4fca-b9e7-fc77ac91a601 => generated 1522 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:02:02.021419 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-5b770a40-eff0-47fe-b27a-86538db5241d tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:02:02.022032 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-5b770a40-eff0-47fe-b27a-86538db5241d tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] [instance: c2b8ba99-d845-4fca-b9e7-fc77ac91a601] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:02:02.034226 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-5b770a40-eff0-47fe-b27a-86538db5241d tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:02.034710 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-5b770a40-eff0-47fe-b27a-86538db5241d tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:02.035513 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-5b770a40-eff0-47fe-b27a-86538db5241d tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:02.035988 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-5b770a40-eff0-47fe-b27a-86538db5241d tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:02.180404 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-5b770a40-eff0-47fe-b27a-86538db5241d tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '243e592fbf1844d89f55dd5035a684f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60447df5461141e883d207e028b74bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:02:02.188338 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-5b770a40-eff0-47fe-b27a-86538db5241d tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] 10.222.0.17 "GET /compute/v2.1/servers/c2b8ba99-d845-4fca-b9e7-fc77ac91a601" status: 200 len: 1522 microversion: 2.1 time: 0.170700 Jun 16 23:02:02.188977 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 103/212] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:02:02 2022] GET /compute/v2.1/servers/c2b8ba99-d845-4fca-b9e7-fc77ac91a601 => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:02:03.205412 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-beb01ed3-0e17-4fdb-8909-37302e633ced tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:02:03.212169 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-beb01ed3-0e17-4fdb-8909-37302e633ced tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] [instance: c2b8ba99-d845-4fca-b9e7-fc77ac91a601] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:02:03.219424 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-beb01ed3-0e17-4fdb-8909-37302e633ced tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:03.219873 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-beb01ed3-0e17-4fdb-8909-37302e633ced tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:03.220780 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-beb01ed3-0e17-4fdb-8909-37302e633ced tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:03.221335 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-beb01ed3-0e17-4fdb-8909-37302e633ced tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:03.370968 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-beb01ed3-0e17-4fdb-8909-37302e633ced tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '243e592fbf1844d89f55dd5035a684f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60447df5461141e883d207e028b74bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:02:03.379354 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-beb01ed3-0e17-4fdb-8909-37302e633ced tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] 10.222.0.17 "GET /compute/v2.1/servers/c2b8ba99-d845-4fca-b9e7-fc77ac91a601" status: 200 len: 1522 microversion: 2.1 time: 0.177743 Jun 16 23:02:03.379932 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 110/213] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:02:03 2022] GET /compute/v2.1/servers/c2b8ba99-d845-4fca-b9e7-fc77ac91a601 => generated 1522 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:02:04.396815 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-22212d25-2f57-4d8b-9fb7-2e8ee32aaa66 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:02:04.397420 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-22212d25-2f57-4d8b-9fb7-2e8ee32aaa66 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] [instance: c2b8ba99-d845-4fca-b9e7-fc77ac91a601] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:02:04.403354 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-22212d25-2f57-4d8b-9fb7-2e8ee32aaa66 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:04.403796 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-22212d25-2f57-4d8b-9fb7-2e8ee32aaa66 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:04.404549 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-22212d25-2f57-4d8b-9fb7-2e8ee32aaa66 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:04.404983 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-22212d25-2f57-4d8b-9fb7-2e8ee32aaa66 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:04.616276 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-22212d25-2f57-4d8b-9fb7-2e8ee32aaa66 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '243e592fbf1844d89f55dd5035a684f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60447df5461141e883d207e028b74bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:02:04.625775 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-22212d25-2f57-4d8b-9fb7-2e8ee32aaa66 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] 10.222.0.17 "GET /compute/v2.1/servers/c2b8ba99-d845-4fca-b9e7-fc77ac91a601" status: 200 len: 1502 microversion: 2.1 time: 0.232812 Jun 16 23:02:04.626379 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 104/214] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:02:04 2022] GET /compute/v2.1/servers/c2b8ba99-d845-4fca-b9e7-fc77ac91a601 => generated 1502 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:02:04.642799 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-9762a9d3-2a74-4833-8772-d058be66cd44 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:02:04.643442 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-9762a9d3-2a74-4833-8772-d058be66cd44 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] [instance: 4ad3ba60-bc63-4d0a-be00-f9b00e66d803] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:02:04.661579 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-9762a9d3-2a74-4833-8772-d058be66cd44 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:04.662050 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-9762a9d3-2a74-4833-8772-d058be66cd44 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:04.662883 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-9762a9d3-2a74-4833-8772-d058be66cd44 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:04.663328 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-9762a9d3-2a74-4833-8772-d058be66cd44 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:04.671386 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG dbcounter [-] [117562] Writing DB stats nova_cell1:SELECT=100 {{(pid=117562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 23:02:04.840946 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-a4f416ae-0ad3-4696-a5e0-245df3601fc0 tempest-VolumesTestJSON-249463091 tempest-VolumesTestJSON-249463091-project] Calling method '.version_select at 0x7f53201f5ca0>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:02:04.897104 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-a4f416ae-0ad3-4696-a5e0-245df3601fc0 tempest-VolumesTestJSON-249463091 tempest-VolumesTestJSON-249463091-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/62589b71-d6c7-49e1-ac07-dac70cff63ce" status: 200 len: 351 microversion: 2.1 time: 0.060044 Jun 16 23:02:04.898028 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 105/215] 10.222.0.17 () {58 vars in 1244 bytes} [Thu Jun 16 23:02:04 2022] GET /compute/v2.1/os-volumes/62589b71-d6c7-49e1-ac07-dac70cff63ce => generated 351 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 23:02:05.056347 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-9762a9d3-2a74-4833-8772-d058be66cd44 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '243e592fbf1844d89f55dd5035a684f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60447df5461141e883d207e028b74bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:02:05.065212 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-9762a9d3-2a74-4833-8772-d058be66cd44 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] 10.222.0.17 "GET /compute/v2.1/servers/4ad3ba60-bc63-4d0a-be00-f9b00e66d803" status: 200 len: 1515 microversion: 2.1 time: 0.426205 Jun 16 23:02:05.065797 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 111/216] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:02:04 2022] GET /compute/v2.1/servers/4ad3ba60-bc63-4d0a-be00-f9b00e66d803 => generated 1515 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:02:06.323852 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-dd49743f-713c-4e07-aaa9-3d5374560499 tempest-VolumesTestJSON-249463091 tempest-VolumesTestJSON-249463091-project] Calling method '.version_select at 0x7f5320071310>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:02:06.377385 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-dd49743f-713c-4e07-aaa9-3d5374560499 tempest-VolumesTestJSON-249463091 tempest-VolumesTestJSON-249463091-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/663970f7-ca01-4113-8853-7644a1aca5d9" status: 200 len: 350 microversion: 2.1 time: 0.057836 Jun 16 23:02:06.377991 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 106/217] 10.222.0.17 () {58 vars in 1244 bytes} [Thu Jun 16 23:02:06 2022] GET /compute/v2.1/os-volumes/663970f7-ca01-4113-8853-7644a1aca5d9 => generated 350 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 23:02:06.492632 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-08a696d6-5a98-4fdf-8d62-7242cb9f9990 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 23:02:06.493622 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-08a696d6-5a98-4fdf-8d62-7242cb9f9990 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] [instance: 4ad3ba60-bc63-4d0a-be00-f9b00e66d803] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:02:06.500083 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-08a696d6-5a98-4fdf-8d62-7242cb9f9990 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:06.500527 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-08a696d6-5a98-4fdf-8d62-7242cb9f9990 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:06.501310 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-08a696d6-5a98-4fdf-8d62-7242cb9f9990 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:06.501740 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-08a696d6-5a98-4fdf-8d62-7242cb9f9990 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:06.525244 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.objects.instance [None req-08a696d6-5a98-4fdf-8d62-7242cb9f9990 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lazy-loading 'flavor' on Instance uuid 4ad3ba60-bc63-4d0a-be00-f9b00e66d803 {{(pid=117562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 23:02:06.645883 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-08a696d6-5a98-4fdf-8d62-7242cb9f9990 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] 10.222.0.17 "POST /compute/v2.1/servers/4ad3ba60-bc63-4d0a-be00-f9b00e66d803/action" status: 200 len: 32 microversion: 2.1 time: 0.154638 Jun 16 23:02:06.650830 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 112/218] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Jun 16 23:02:06 2022] POST /compute/v2.1/servers/4ad3ba60-bc63-4d0a-be00-f9b00e66d803/action => generated 32 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 23:02:06.674420 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-a03c962e-a19e-4203-b541-c7404c4f782f tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:02:06.677405 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-a03c962e-a19e-4203-b541-c7404c4f782f tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] [instance: 4ad3ba60-bc63-4d0a-be00-f9b00e66d803] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:02:06.692694 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-a03c962e-a19e-4203-b541-c7404c4f782f tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:06.693423 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-a03c962e-a19e-4203-b541-c7404c4f782f tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:06.695291 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-a03c962e-a19e-4203-b541-c7404c4f782f tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:06.696050 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-a03c962e-a19e-4203-b541-c7404c4f782f tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:06.890847 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-a03c962e-a19e-4203-b541-c7404c4f782f tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '243e592fbf1844d89f55dd5035a684f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60447df5461141e883d207e028b74bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:02:06.899119 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-a03c962e-a19e-4203-b541-c7404c4f782f tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] 10.222.0.17 "GET /compute/v2.1/servers/4ad3ba60-bc63-4d0a-be00-f9b00e66d803" status: 200 len: 1521 microversion: 2.1 time: 0.246496 Jun 16 23:02:06.899903 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 107/219] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:02:06 2022] GET /compute/v2.1/servers/4ad3ba60-bc63-4d0a-be00-f9b00e66d803 => generated 1521 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:02:07.812222 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG dbcounter [-] [117562] Writing DB stats nova_cell0:SELECT=4 {{(pid=117562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 23:02:07.818212 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-a740347b-4bae-4117-b211-8d8e97a36f4e tempest-VolumesTestJSON-249463091 tempest-VolumesTestJSON-249463091-project] Calling method '.version_select at 0x7f532010b670>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:02:07.899007 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-a740347b-4bae-4117-b211-8d8e97a36f4e tempest-VolumesTestJSON-249463091 tempest-VolumesTestJSON-249463091-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/5e4831ec-734c-4139-a6f9-d53ef7cb025f" status: 200 len: 350 microversion: 2.1 time: 0.088579 Jun 16 23:02:07.905829 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 113/220] 10.222.0.17 () {58 vars in 1244 bytes} [Thu Jun 16 23:02:07 2022] GET /compute/v2.1/os-volumes/5e4831ec-734c-4139-a6f9-d53ef7cb025f => generated 350 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 23:02:07.910720 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-e88a5f29-47ee-4c71-87eb-9e5bdfd4eaef tempest-VolumesTestJSON-249463091 tempest-VolumesTestJSON-249463091-project] Calling method '.version_select at 0x7f532006db80>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:02:07.918143 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-8632af68-65e7-4960-8c39-92ec291b07f4 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:02:07.919787 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-8632af68-65e7-4960-8c39-92ec291b07f4 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] [instance: 4ad3ba60-bc63-4d0a-be00-f9b00e66d803] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:02:07.927500 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-8632af68-65e7-4960-8c39-92ec291b07f4 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:07.928008 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-8632af68-65e7-4960-8c39-92ec291b07f4 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:07.928796 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-8632af68-65e7-4960-8c39-92ec291b07f4 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:07.929238 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-8632af68-65e7-4960-8c39-92ec291b07f4 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:08.002227 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-e88a5f29-47ee-4c71-87eb-9e5bdfd4eaef tempest-VolumesTestJSON-249463091 tempest-VolumesTestJSON-249463091-project] 10.222.0.17 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.095417 Jun 16 23:02:08.006637 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 108/221] 10.222.0.17 () {58 vars in 1133 bytes} [Thu Jun 16 23:02:07 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:02:08.017546 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-2637fdd2-1a0f-4bbd-81d7-2b3c5f0f4748 tempest-VolumesTestJSON-249463091 tempest-VolumesTestJSON-249463091-project] Calling method '.version_select at 0x7f5321422550>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:02:08.110714 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-2637fdd2-1a0f-4bbd-81d7-2b3c5f0f4748 tempest-VolumesTestJSON-249463091 tempest-VolumesTestJSON-249463091-project] 10.222.0.17 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.096618 Jun 16 23:02:08.112870 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 109/222] 10.222.0.17 () {58 vars in 1148 bytes} [Thu Jun 16 23:02:08 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 23:02:08.132546 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-f0ce364b-d41a-4c3c-8462-698c3976be18 tempest-VolumesTestJSON-249463091 tempest-VolumesTestJSON-249463091-project] Calling method '.version_select at 0x7f53201b5e50>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:02:08.157722 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-8632af68-65e7-4960-8c39-92ec291b07f4 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '243e592fbf1844d89f55dd5035a684f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60447df5461141e883d207e028b74bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:02:08.166105 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-8632af68-65e7-4960-8c39-92ec291b07f4 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] 10.222.0.17 "GET /compute/v2.1/servers/4ad3ba60-bc63-4d0a-be00-f9b00e66d803" status: 200 len: 1521 microversion: 2.1 time: 0.252740 Jun 16 23:02:08.167053 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 114/223] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:02:07 2022] GET /compute/v2.1/servers/4ad3ba60-bc63-4d0a-be00-f9b00e66d803 => generated 1521 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:02:08.240293 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-f0ce364b-d41a-4c3c-8462-698c3976be18 tempest-VolumesTestJSON-249463091 tempest-VolumesTestJSON-249463091-project] 10.222.0.17 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.115648 Jun 16 23:02:08.241088 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 110/224] 10.222.0.17 () {58 vars in 1133 bytes} [Thu Jun 16 23:02:08 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 23:02:08.253303 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-72a5d328-79f8-4667-bf5e-93dbbcf2dfcd tempest-VolumesTestJSON-249463091 tempest-VolumesTestJSON-249463091-project] Calling method '.version_select at 0x7f53200d0160>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:02:08.368317 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-72a5d328-79f8-4667-bf5e-93dbbcf2dfcd tempest-VolumesTestJSON-249463091 tempest-VolumesTestJSON-249463091-project] 10.222.0.17 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.119119 Jun 16 23:02:08.369321 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 115/225] 10.222.0.17 () {58 vars in 1166 bytes} [Thu Jun 16 23:02:08 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 23:02:08.383442 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-1ec58bcd-0d1a-425f-9ddc-391563b38dd8 tempest-VolumesTestJSON-249463091 tempest-VolumesTestJSON-249463091-project] Calling method '.version_select at 0x7f53201f5790>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:02:08.486107 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-1ec58bcd-0d1a-425f-9ddc-391563b38dd8 tempest-VolumesTestJSON-249463091 tempest-VolumesTestJSON-249463091-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.106315 Jun 16 23:02:08.487008 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 111/226] 10.222.0.17 () {58 vars in 1169 bytes} [Thu Jun 16 23:02:08 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 23:02:08.499827 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-a9b11b04-752e-4377-9dbf-b6fd7502220f tempest-VolumesTestJSON-249463091 tempest-VolumesTestJSON-249463091-project] Calling method '.version_select at 0x7f53200645e0>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:02:08.585359 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-a9b11b04-752e-4377-9dbf-b6fd7502220f tempest-VolumesTestJSON-249463091 tempest-VolumesTestJSON-249463091-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.089757 Jun 16 23:02:08.586413 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 116/227] 10.222.0.17 () {58 vars in 1154 bytes} [Thu Jun 16 23:02:08 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:02:08.598258 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-a84b0b83-af04-4073-9967-6975cbae96ea tempest-VolumesTestJSON-249463091 tempest-VolumesTestJSON-249463091-project] Calling method '.version_select at 0x7f5320064b80>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:02:08.698879 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-a84b0b83-af04-4073-9967-6975cbae96ea tempest-VolumesTestJSON-249463091 tempest-VolumesTestJSON-249463091-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.104420 Jun 16 23:02:08.699569 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 112/228] 10.222.0.17 () {58 vars in 1187 bytes} [Thu Jun 16 23:02:08 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 23:02:08.712720 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-d9318ca1-5804-41bc-a309-ebf115385058 tempest-VolumesTestJSON-249463091 tempest-VolumesTestJSON-249463091-project] Calling method '.version_select at 0x7f53200da160>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:02:08.810908 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-d9318ca1-5804-41bc-a309-ebf115385058 tempest-VolumesTestJSON-249463091 tempest-VolumesTestJSON-249463091-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.101783 Jun 16 23:02:08.811475 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 117/229] 10.222.0.17 () {58 vars in 1154 bytes} [Thu Jun 16 23:02:08 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:02:09.185094 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-1ed3560c-07d4-4c42-bab5-65257c462b63 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:02:09.185729 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-1ed3560c-07d4-4c42-bab5-65257c462b63 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] [instance: 4ad3ba60-bc63-4d0a-be00-f9b00e66d803] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:02:09.192433 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-1ed3560c-07d4-4c42-bab5-65257c462b63 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:09.192953 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-1ed3560c-07d4-4c42-bab5-65257c462b63 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:09.193632 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-1ed3560c-07d4-4c42-bab5-65257c462b63 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:09.194079 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-1ed3560c-07d4-4c42-bab5-65257c462b63 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:09.377800 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-1ed3560c-07d4-4c42-bab5-65257c462b63 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '243e592fbf1844d89f55dd5035a684f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60447df5461141e883d207e028b74bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:02:09.387467 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-1ed3560c-07d4-4c42-bab5-65257c462b63 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] 10.222.0.17 "GET /compute/v2.1/servers/4ad3ba60-bc63-4d0a-be00-f9b00e66d803" status: 200 len: 1521 microversion: 2.1 time: 0.206854 Jun 16 23:02:09.388500 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 113/230] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:02:09 2022] GET /compute/v2.1/servers/4ad3ba60-bc63-4d0a-be00-f9b00e66d803 => generated 1521 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:02:10.405433 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-a3c6c119-9ca2-4b13-9d7d-800a4378844f tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:02:10.406047 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-a3c6c119-9ca2-4b13-9d7d-800a4378844f tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] [instance: 4ad3ba60-bc63-4d0a-be00-f9b00e66d803] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:02:10.413057 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-a3c6c119-9ca2-4b13-9d7d-800a4378844f tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:10.413512 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-a3c6c119-9ca2-4b13-9d7d-800a4378844f tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:10.414504 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-a3c6c119-9ca2-4b13-9d7d-800a4378844f tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:10.415146 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-a3c6c119-9ca2-4b13-9d7d-800a4378844f tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:10.583167 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-a3c6c119-9ca2-4b13-9d7d-800a4378844f tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '243e592fbf1844d89f55dd5035a684f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60447df5461141e883d207e028b74bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:02:10.594951 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-a3c6c119-9ca2-4b13-9d7d-800a4378844f tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] 10.222.0.17 "GET /compute/v2.1/servers/4ad3ba60-bc63-4d0a-be00-f9b00e66d803" status: 200 len: 1521 microversion: 2.1 time: 0.193425 Jun 16 23:02:10.606495 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 118/231] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:02:10 2022] GET /compute/v2.1/servers/4ad3ba60-bc63-4d0a-be00-f9b00e66d803 => generated 1521 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:02:11.612036 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-726f7cda-54ec-4fc7-b1a3-31a692dddbe0 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:02:11.612602 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-726f7cda-54ec-4fc7-b1a3-31a692dddbe0 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] [instance: 4ad3ba60-bc63-4d0a-be00-f9b00e66d803] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:02:11.615031 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG dbcounter [-] [117563] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=1 {{(pid=117563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 23:02:11.621989 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-726f7cda-54ec-4fc7-b1a3-31a692dddbe0 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:11.622446 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-726f7cda-54ec-4fc7-b1a3-31a692dddbe0 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:11.623250 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-726f7cda-54ec-4fc7-b1a3-31a692dddbe0 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:11.623686 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-726f7cda-54ec-4fc7-b1a3-31a692dddbe0 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:11.767504 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-726f7cda-54ec-4fc7-b1a3-31a692dddbe0 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '243e592fbf1844d89f55dd5035a684f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60447df5461141e883d207e028b74bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:02:11.775166 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-726f7cda-54ec-4fc7-b1a3-31a692dddbe0 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] 10.222.0.17 "GET /compute/v2.1/servers/4ad3ba60-bc63-4d0a-be00-f9b00e66d803" status: 200 len: 1521 microversion: 2.1 time: 0.167046 Jun 16 23:02:11.775718 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 114/232] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:02:11 2022] GET /compute/v2.1/servers/4ad3ba60-bc63-4d0a-be00-f9b00e66d803 => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:02:11.786443 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-920c82b5-40d6-4063-9955-b77def42cd64 tempest-VolumesNegativeTest-2127792717 tempest-VolumesNegativeTest-2127792717-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-897769016", "imageRef": "2b486731-e5ea-4159-b6b1-ed0083e00543", "flavorRef": "452"}} {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 23:02:11.836947 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.network.neutron [None req-920c82b5-40d6-4063-9955-b77def42cd64 tempest-VolumesNegativeTest-2127792717 tempest-VolumesNegativeTest-2127792717-project] validate_networks() for None {{(pid=117562) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 23:02:12.155683 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.virt.hardware [None req-920c82b5-40d6-4063-9955-b77def42cd64 tempest-VolumesNegativeTest-2127792717 tempest-VolumesNegativeTest-2127792717-project] Flavor limits 0:0:0 {{(pid=117562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 23:02:12.156242 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.virt.hardware [None req-920c82b5-40d6-4063-9955-b77def42cd64 tempest-VolumesNegativeTest-2127792717 tempest-VolumesNegativeTest-2127792717-project] Image limits 0:0:0 {{(pid=117562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 23:02:12.156785 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.virt.hardware [None req-920c82b5-40d6-4063-9955-b77def42cd64 tempest-VolumesNegativeTest-2127792717 tempest-VolumesNegativeTest-2127792717-project] Flavor pref 0:0:0 {{(pid=117562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 23:02:12.157292 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.virt.hardware [None req-920c82b5-40d6-4063-9955-b77def42cd64 tempest-VolumesNegativeTest-2127792717 tempest-VolumesNegativeTest-2127792717-project] Image pref 0:0:0 {{(pid=117562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 23:02:12.157849 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.virt.hardware [None req-920c82b5-40d6-4063-9955-b77def42cd64 tempest-VolumesNegativeTest-2127792717 tempest-VolumesNegativeTest-2127792717-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 23:02:12.167568 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-920c82b5-40d6-4063-9955-b77def42cd64 tempest-VolumesNegativeTest-2127792717 tempest-VolumesNegativeTest-2127792717-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:12.168610 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-920c82b5-40d6-4063-9955-b77def42cd64 tempest-VolumesNegativeTest-2127792717 tempest-VolumesNegativeTest-2127792717-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:12.169484 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-920c82b5-40d6-4063-9955-b77def42cd64 tempest-VolumesNegativeTest-2127792717 tempest-VolumesNegativeTest-2127792717-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:12.169992 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-920c82b5-40d6-4063-9955-b77def42cd64 tempest-VolumesNegativeTest-2127792717 tempest-VolumesNegativeTest-2127792717-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:12.187330 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.quota [None req-920c82b5-40d6-4063-9955-b77def42cd64 tempest-VolumesNegativeTest-2127792717 tempest-VolumesNegativeTest-2127792717-project] Getting quotas for project c90a3d32fe204da7a969528722141e75. Resources: {'instances', 'cores', 'ram'} {{(pid=117562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 23:02:12.191396 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.quota [None req-920c82b5-40d6-4063-9955-b77def42cd64 tempest-VolumesNegativeTest-2127792717 tempest-VolumesNegativeTest-2127792717-project] Getting quotas for user 0ee1c54733f648ada66a143ce7516375 and project c90a3d32fe204da7a969528722141e75. Resources: {'instances', 'cores', 'ram'} {{(pid=117562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 23:02:12.202510 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-920c82b5-40d6-4063-9955-b77def42cd64 tempest-VolumesNegativeTest-2127792717 tempest-VolumesNegativeTest-2127792717-project] Going to run 1 instances... {{(pid=117562) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 23:02:12.204783 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-920c82b5-40d6-4063-9955-b77def42cd64 tempest-VolumesNegativeTest-2127792717 tempest-VolumesNegativeTest-2127792717-project] [instance: ee275bd4-5cd1-46e8-9084-74b027db92fa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2b486731-e5ea-4159-b6b1-ed0083e00543',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 23:02:12.256392 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-920c82b5-40d6-4063-9955-b77def42cd64 tempest-VolumesNegativeTest-2127792717 tempest-VolumesNegativeTest-2127792717-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.473727 Jun 16 23:02:12.261983 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 119/233] 10.222.0.17 () {60 vars in 1146 bytes} [Thu Jun 16 23:02:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 479 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 16 23:02:12.267037 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-c8a61572-4a4b-4282-9db9-53e8feac8976 tempest-VolumesNegativeTest-2127792717 tempest-VolumesNegativeTest-2127792717-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:02:12.267782 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-c8a61572-4a4b-4282-9db9-53e8feac8976 tempest-VolumesNegativeTest-2127792717 tempest-VolumesNegativeTest-2127792717-project] [instance: ee275bd4-5cd1-46e8-9084-74b027db92fa] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:02:12.323143 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-c8a61572-4a4b-4282-9db9-53e8feac8976 tempest-VolumesNegativeTest-2127792717 tempest-VolumesNegativeTest-2127792717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ee1c54733f648ada66a143ce7516375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90a3d32fe204da7a969528722141e75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:02:12.330258 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-c8a61572-4a4b-4282-9db9-53e8feac8976 tempest-VolumesNegativeTest-2127792717 tempest-VolumesNegativeTest-2127792717-project] 10.222.0.17 "GET /compute/v2.1/servers/ee275bd4-5cd1-46e8-9084-74b027db92fa" status: 200 len: 1214 microversion: 2.1 time: 0.066929 Jun 16 23:02:12.332923 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 115/234] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:02:12 2022] GET /compute/v2.1/servers/ee275bd4-5cd1-46e8-9084-74b027db92fa => generated 1214 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:02:12.791807 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-9854643e-22c5-4db8-913c-9eba0f7180a7 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:02:12.793188 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-9854643e-22c5-4db8-913c-9eba0f7180a7 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] [instance: 4ad3ba60-bc63-4d0a-be00-f9b00e66d803] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:02:12.799399 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-9854643e-22c5-4db8-913c-9eba0f7180a7 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:12.800522 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-9854643e-22c5-4db8-913c-9eba0f7180a7 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:12.801504 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-9854643e-22c5-4db8-913c-9eba0f7180a7 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:12.802130 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-9854643e-22c5-4db8-913c-9eba0f7180a7 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:13.066483 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-9854643e-22c5-4db8-913c-9eba0f7180a7 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '243e592fbf1844d89f55dd5035a684f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60447df5461141e883d207e028b74bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:02:13.075002 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-9854643e-22c5-4db8-913c-9eba0f7180a7 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] 10.222.0.17 "GET /compute/v2.1/servers/4ad3ba60-bc63-4d0a-be00-f9b00e66d803" status: 200 len: 1521 microversion: 2.1 time: 0.287065 Jun 16 23:02:13.076033 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 120/235] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:02:12 2022] GET /compute/v2.1/servers/4ad3ba60-bc63-4d0a-be00-f9b00e66d803 => generated 1521 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:02:13.349990 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-20097fd3-0fa8-43dc-b284-8ef84de7da88 tempest-VolumesNegativeTest-2127792717 tempest-VolumesNegativeTest-2127792717-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:02:13.350634 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-20097fd3-0fa8-43dc-b284-8ef84de7da88 tempest-VolumesNegativeTest-2127792717 tempest-VolumesNegativeTest-2127792717-project] [instance: ee275bd4-5cd1-46e8-9084-74b027db92fa] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:02:13.357883 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-20097fd3-0fa8-43dc-b284-8ef84de7da88 tempest-VolumesNegativeTest-2127792717 tempest-VolumesNegativeTest-2127792717-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:13.358407 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-20097fd3-0fa8-43dc-b284-8ef84de7da88 tempest-VolumesNegativeTest-2127792717 tempest-VolumesNegativeTest-2127792717-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:13.359615 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-20097fd3-0fa8-43dc-b284-8ef84de7da88 tempest-VolumesNegativeTest-2127792717 tempest-VolumesNegativeTest-2127792717-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:13.360152 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-20097fd3-0fa8-43dc-b284-8ef84de7da88 tempest-VolumesNegativeTest-2127792717 tempest-VolumesNegativeTest-2127792717-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:13.456956 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-20097fd3-0fa8-43dc-b284-8ef84de7da88 tempest-VolumesNegativeTest-2127792717 tempest-VolumesNegativeTest-2127792717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ee1c54733f648ada66a143ce7516375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90a3d32fe204da7a969528722141e75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:02:13.466853 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-20097fd3-0fa8-43dc-b284-8ef84de7da88 tempest-VolumesNegativeTest-2127792717 tempest-VolumesNegativeTest-2127792717-project] 10.222.0.17 "GET /compute/v2.1/servers/ee275bd4-5cd1-46e8-9084-74b027db92fa" status: 200 len: 1266 microversion: 2.1 time: 0.120939 Jun 16 23:02:13.475781 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 116/236] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:02:13 2022] GET /compute/v2.1/servers/ee275bd4-5cd1-46e8-9084-74b027db92fa => generated 1266 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:02:14.092816 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-920d564c-2d33-44ae-bd32-06d04f3262a4 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:02:14.093416 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-920d564c-2d33-44ae-bd32-06d04f3262a4 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] [instance: 4ad3ba60-bc63-4d0a-be00-f9b00e66d803] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:02:14.099523 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-920d564c-2d33-44ae-bd32-06d04f3262a4 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:14.100187 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-920d564c-2d33-44ae-bd32-06d04f3262a4 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:14.101120 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-920d564c-2d33-44ae-bd32-06d04f3262a4 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:14.101718 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-920d564c-2d33-44ae-bd32-06d04f3262a4 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:14.260928 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-920d564c-2d33-44ae-bd32-06d04f3262a4 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '243e592fbf1844d89f55dd5035a684f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60447df5461141e883d207e028b74bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:02:14.269356 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-920d564c-2d33-44ae-bd32-06d04f3262a4 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] 10.222.0.17 "GET /compute/v2.1/servers/4ad3ba60-bc63-4d0a-be00-f9b00e66d803" status: 200 len: 1521 microversion: 2.1 time: 0.180995 Jun 16 23:02:14.270101 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 121/237] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:02:14 2022] GET /compute/v2.1/servers/4ad3ba60-bc63-4d0a-be00-f9b00e66d803 => generated 1521 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:02:14.484376 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-55588f3d-7da9-4d01-be7b-5fbd379509ef tempest-VolumesNegativeTest-2127792717 tempest-VolumesNegativeTest-2127792717-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:02:14.485190 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-55588f3d-7da9-4d01-be7b-5fbd379509ef tempest-VolumesNegativeTest-2127792717 tempest-VolumesNegativeTest-2127792717-project] [instance: ee275bd4-5cd1-46e8-9084-74b027db92fa] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:02:14.492618 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-55588f3d-7da9-4d01-be7b-5fbd379509ef tempest-VolumesNegativeTest-2127792717 tempest-VolumesNegativeTest-2127792717-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:14.493179 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-55588f3d-7da9-4d01-be7b-5fbd379509ef tempest-VolumesNegativeTest-2127792717 tempest-VolumesNegativeTest-2127792717-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:14.494956 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-55588f3d-7da9-4d01-be7b-5fbd379509ef tempest-VolumesNegativeTest-2127792717 tempest-VolumesNegativeTest-2127792717-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:14.495430 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-55588f3d-7da9-4d01-be7b-5fbd379509ef tempest-VolumesNegativeTest-2127792717 tempest-VolumesNegativeTest-2127792717-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:14.500455 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG dbcounter [-] [117563] Writing DB stats nova_cell1:SELECT=100 {{(pid=117563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 23:02:14.668428 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-55588f3d-7da9-4d01-be7b-5fbd379509ef tempest-VolumesNegativeTest-2127792717 tempest-VolumesNegativeTest-2127792717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ee1c54733f648ada66a143ce7516375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90a3d32fe204da7a969528722141e75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:02:14.678707 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-55588f3d-7da9-4d01-be7b-5fbd379509ef tempest-VolumesNegativeTest-2127792717 tempest-VolumesNegativeTest-2127792717-project] 10.222.0.17 "GET /compute/v2.1/servers/ee275bd4-5cd1-46e8-9084-74b027db92fa" status: 200 len: 1314 microversion: 2.1 time: 0.198641 Jun 16 23:02:14.681099 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 117/238] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:02:14 2022] GET /compute/v2.1/servers/ee275bd4-5cd1-46e8-9084-74b027db92fa => generated 1314 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:02:15.286674 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-e9b1d490-3b7f-488a-ba73-757c3d83d21d tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:02:15.287785 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-e9b1d490-3b7f-488a-ba73-757c3d83d21d tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] [instance: 4ad3ba60-bc63-4d0a-be00-f9b00e66d803] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:02:15.294279 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-e9b1d490-3b7f-488a-ba73-757c3d83d21d tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:15.295022 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-e9b1d490-3b7f-488a-ba73-757c3d83d21d tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:15.295968 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-e9b1d490-3b7f-488a-ba73-757c3d83d21d tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:15.296635 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-e9b1d490-3b7f-488a-ba73-757c3d83d21d tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:15.460777 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [req-3866395d-3c8c-4c48-8e27-999acd291d8c req-882c3635-e23b-4e2e-a298-c5ba58802a9a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee275bd4-5cd1-46e8-9084-74b027db92fa", "tag": "a147f1db-e24c-4a2c-885e-59f4a826c62c"}]} {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 23:02:15.490160 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-3866395d-3c8c-4c48-8e27-999acd291d8c req-882c3635-e23b-4e2e-a298-c5ba58802a9a service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:15.491714 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-3866395d-3c8c-4c48-8e27-999acd291d8c req-882c3635-e23b-4e2e-a298-c5ba58802a9a service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:15.522523 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.compute.server_external_events [req-3866395d-3c8c-4c48-8e27-999acd291d8c req-882c3635-e23b-4e2e-a298-c5ba58802a9a service nova] Creating event network-changed:a147f1db-e24c-4a2c-885e-59f4a826c62c for instance ee275bd4-5cd1-46e8-9084-74b027db92fa on hv-cinder-84623 Jun 16 23:02:15.532202 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [req-3866395d-3c8c-4c48-8e27-999acd291d8c req-882c3635-e23b-4e2e-a298-c5ba58802a9a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078854 Jun 16 23:02:15.533018 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 118/239] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 23:02:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 23:02:15.540386 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-e9b1d490-3b7f-488a-ba73-757c3d83d21d tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '243e592fbf1844d89f55dd5035a684f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60447df5461141e883d207e028b74bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:02:15.548970 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-e9b1d490-3b7f-488a-ba73-757c3d83d21d tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] 10.222.0.17 "GET /compute/v2.1/servers/4ad3ba60-bc63-4d0a-be00-f9b00e66d803" status: 200 len: 1521 microversion: 2.1 time: 0.266558 Jun 16 23:02:15.549555 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 122/240] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:02:15 2022] GET /compute/v2.1/servers/4ad3ba60-bc63-4d0a-be00-f9b00e66d803 => generated 1521 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:02:15.697024 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-bef5dad1-39b1-407f-ad47-7222fb0d28e5 tempest-VolumesNegativeTest-2127792717 tempest-VolumesNegativeTest-2127792717-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:02:15.698053 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-bef5dad1-39b1-407f-ad47-7222fb0d28e5 tempest-VolumesNegativeTest-2127792717 tempest-VolumesNegativeTest-2127792717-project] [instance: ee275bd4-5cd1-46e8-9084-74b027db92fa] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:02:15.705629 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-bef5dad1-39b1-407f-ad47-7222fb0d28e5 tempest-VolumesNegativeTest-2127792717 tempest-VolumesNegativeTest-2127792717-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:15.706072 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-bef5dad1-39b1-407f-ad47-7222fb0d28e5 tempest-VolumesNegativeTest-2127792717 tempest-VolumesNegativeTest-2127792717-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:15.706905 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-bef5dad1-39b1-407f-ad47-7222fb0d28e5 tempest-VolumesNegativeTest-2127792717 tempest-VolumesNegativeTest-2127792717-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:15.707338 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-bef5dad1-39b1-407f-ad47-7222fb0d28e5 tempest-VolumesNegativeTest-2127792717 tempest-VolumesNegativeTest-2127792717-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:15.861286 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-bef5dad1-39b1-407f-ad47-7222fb0d28e5 tempest-VolumesNegativeTest-2127792717 tempest-VolumesNegativeTest-2127792717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ee1c54733f648ada66a143ce7516375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90a3d32fe204da7a969528722141e75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:02:15.869093 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-bef5dad1-39b1-407f-ad47-7222fb0d28e5 tempest-VolumesNegativeTest-2127792717 tempest-VolumesNegativeTest-2127792717-project] 10.222.0.17 "GET /compute/v2.1/servers/ee275bd4-5cd1-46e8-9084-74b027db92fa" status: 200 len: 1314 microversion: 2.1 time: 0.176417 Jun 16 23:02:15.869659 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 119/241] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:02:15 2022] GET /compute/v2.1/servers/ee275bd4-5cd1-46e8-9084-74b027db92fa => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:02:16.586185 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-806b9c28-d84c-46e6-a6f3-27be27dbaccd tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:02:16.586902 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-806b9c28-d84c-46e6-a6f3-27be27dbaccd tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] [instance: 4ad3ba60-bc63-4d0a-be00-f9b00e66d803] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:02:16.594291 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-806b9c28-d84c-46e6-a6f3-27be27dbaccd tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:16.594775 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-806b9c28-d84c-46e6-a6f3-27be27dbaccd tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:16.595550 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-806b9c28-d84c-46e6-a6f3-27be27dbaccd tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:16.596013 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-806b9c28-d84c-46e6-a6f3-27be27dbaccd tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:16.736481 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-806b9c28-d84c-46e6-a6f3-27be27dbaccd tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '243e592fbf1844d89f55dd5035a684f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60447df5461141e883d207e028b74bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:02:16.743945 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-806b9c28-d84c-46e6-a6f3-27be27dbaccd tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] 10.222.0.17 "GET /compute/v2.1/servers/4ad3ba60-bc63-4d0a-be00-f9b00e66d803" status: 200 len: 1521 microversion: 2.1 time: 0.162070 Jun 16 23:02:16.744509 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 123/242] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:02:16 2022] GET /compute/v2.1/servers/4ad3ba60-bc63-4d0a-be00-f9b00e66d803 => generated 1521 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:02:16.886863 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-897fe840-b324-4782-9da4-393730b6b22b tempest-VolumesNegativeTest-2127792717 tempest-VolumesNegativeTest-2127792717-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:02:16.887476 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-897fe840-b324-4782-9da4-393730b6b22b tempest-VolumesNegativeTest-2127792717 tempest-VolumesNegativeTest-2127792717-project] [instance: ee275bd4-5cd1-46e8-9084-74b027db92fa] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:02:16.893902 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-897fe840-b324-4782-9da4-393730b6b22b tempest-VolumesNegativeTest-2127792717 tempest-VolumesNegativeTest-2127792717-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:16.894352 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-897fe840-b324-4782-9da4-393730b6b22b tempest-VolumesNegativeTest-2127792717 tempest-VolumesNegativeTest-2127792717-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:16.895151 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-897fe840-b324-4782-9da4-393730b6b22b tempest-VolumesNegativeTest-2127792717 tempest-VolumesNegativeTest-2127792717-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:16.895591 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-897fe840-b324-4782-9da4-393730b6b22b tempest-VolumesNegativeTest-2127792717 tempest-VolumesNegativeTest-2127792717-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:17.033219 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-897fe840-b324-4782-9da4-393730b6b22b tempest-VolumesNegativeTest-2127792717 tempest-VolumesNegativeTest-2127792717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ee1c54733f648ada66a143ce7516375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90a3d32fe204da7a969528722141e75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:02:17.040486 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-897fe840-b324-4782-9da4-393730b6b22b tempest-VolumesNegativeTest-2127792717 tempest-VolumesNegativeTest-2127792717-project] 10.222.0.17 "GET /compute/v2.1/servers/ee275bd4-5cd1-46e8-9084-74b027db92fa" status: 200 len: 1314 microversion: 2.1 time: 0.157573 Jun 16 23:02:17.041226 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 120/243] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:02:16 2022] GET /compute/v2.1/servers/ee275bd4-5cd1-46e8-9084-74b027db92fa => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:02:17.763103 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-a00bac30-6383-42b5-9f09-3560d036f6f9 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:02:17.764630 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-a00bac30-6383-42b5-9f09-3560d036f6f9 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] [instance: 4ad3ba60-bc63-4d0a-be00-f9b00e66d803] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:02:17.770999 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-a00bac30-6383-42b5-9f09-3560d036f6f9 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:17.771628 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-a00bac30-6383-42b5-9f09-3560d036f6f9 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:17.773092 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-a00bac30-6383-42b5-9f09-3560d036f6f9 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:17.773744 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-a00bac30-6383-42b5-9f09-3560d036f6f9 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:17.916631 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-a00bac30-6383-42b5-9f09-3560d036f6f9 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '243e592fbf1844d89f55dd5035a684f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60447df5461141e883d207e028b74bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:02:17.924716 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-a00bac30-6383-42b5-9f09-3560d036f6f9 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] 10.222.0.17 "GET /compute/v2.1/servers/4ad3ba60-bc63-4d0a-be00-f9b00e66d803" status: 200 len: 1521 microversion: 2.1 time: 0.167731 Jun 16 23:02:17.925282 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 124/244] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:02:17 2022] GET /compute/v2.1/servers/4ad3ba60-bc63-4d0a-be00-f9b00e66d803 => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:02:18.057528 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-b362efab-f3d9-404f-a320-06e22844d5fd tempest-VolumesNegativeTest-2127792717 tempest-VolumesNegativeTest-2127792717-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:02:18.059344 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-b362efab-f3d9-404f-a320-06e22844d5fd tempest-VolumesNegativeTest-2127792717 tempest-VolumesNegativeTest-2127792717-project] [instance: ee275bd4-5cd1-46e8-9084-74b027db92fa] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:02:18.065772 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-b362efab-f3d9-404f-a320-06e22844d5fd tempest-VolumesNegativeTest-2127792717 tempest-VolumesNegativeTest-2127792717-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:18.066226 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-b362efab-f3d9-404f-a320-06e22844d5fd tempest-VolumesNegativeTest-2127792717 tempest-VolumesNegativeTest-2127792717-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:18.067026 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-b362efab-f3d9-404f-a320-06e22844d5fd tempest-VolumesNegativeTest-2127792717 tempest-VolumesNegativeTest-2127792717-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:18.067469 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-b362efab-f3d9-404f-a320-06e22844d5fd tempest-VolumesNegativeTest-2127792717 tempest-VolumesNegativeTest-2127792717-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:18.209114 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-b362efab-f3d9-404f-a320-06e22844d5fd tempest-VolumesNegativeTest-2127792717 tempest-VolumesNegativeTest-2127792717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ee1c54733f648ada66a143ce7516375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90a3d32fe204da7a969528722141e75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:02:18.219133 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-b362efab-f3d9-404f-a320-06e22844d5fd tempest-VolumesNegativeTest-2127792717 tempest-VolumesNegativeTest-2127792717-project] 10.222.0.17 "GET /compute/v2.1/servers/ee275bd4-5cd1-46e8-9084-74b027db92fa" status: 200 len: 1314 microversion: 2.1 time: 0.165585 Jun 16 23:02:18.219542 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 121/245] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:02:18 2022] GET /compute/v2.1/servers/ee275bd4-5cd1-46e8-9084-74b027db92fa => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:02:18.942265 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-fdff8cb5-382e-4d79-adfc-f136638e1777 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:02:18.942796 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-fdff8cb5-382e-4d79-adfc-f136638e1777 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] [instance: 4ad3ba60-bc63-4d0a-be00-f9b00e66d803] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:02:18.948770 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-fdff8cb5-382e-4d79-adfc-f136638e1777 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:18.949216 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-fdff8cb5-382e-4d79-adfc-f136638e1777 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:18.949969 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-fdff8cb5-382e-4d79-adfc-f136638e1777 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:18.950396 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-fdff8cb5-382e-4d79-adfc-f136638e1777 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:19.078286 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-fdff8cb5-382e-4d79-adfc-f136638e1777 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '243e592fbf1844d89f55dd5035a684f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60447df5461141e883d207e028b74bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:02:19.085973 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-fdff8cb5-382e-4d79-adfc-f136638e1777 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] 10.222.0.17 "GET /compute/v2.1/servers/4ad3ba60-bc63-4d0a-be00-f9b00e66d803" status: 200 len: 1521 microversion: 2.1 time: 0.147613 Jun 16 23:02:19.086773 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 125/246] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:02:18 2022] GET /compute/v2.1/servers/4ad3ba60-bc63-4d0a-be00-f9b00e66d803 => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:02:19.237209 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-3a3639e6-495d-4a3b-b49f-eba7107909d3 tempest-VolumesNegativeTest-2127792717 tempest-VolumesNegativeTest-2127792717-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:02:19.239318 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-3a3639e6-495d-4a3b-b49f-eba7107909d3 tempest-VolumesNegativeTest-2127792717 tempest-VolumesNegativeTest-2127792717-project] [instance: ee275bd4-5cd1-46e8-9084-74b027db92fa] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:02:19.245894 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-3a3639e6-495d-4a3b-b49f-eba7107909d3 tempest-VolumesNegativeTest-2127792717 tempest-VolumesNegativeTest-2127792717-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:19.246341 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-3a3639e6-495d-4a3b-b49f-eba7107909d3 tempest-VolumesNegativeTest-2127792717 tempest-VolumesNegativeTest-2127792717-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:19.247152 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-3a3639e6-495d-4a3b-b49f-eba7107909d3 tempest-VolumesNegativeTest-2127792717 tempest-VolumesNegativeTest-2127792717-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:19.247591 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-3a3639e6-495d-4a3b-b49f-eba7107909d3 tempest-VolumesNegativeTest-2127792717 tempest-VolumesNegativeTest-2127792717-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:19.397713 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-3a3639e6-495d-4a3b-b49f-eba7107909d3 tempest-VolumesNegativeTest-2127792717 tempest-VolumesNegativeTest-2127792717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ee1c54733f648ada66a143ce7516375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90a3d32fe204da7a969528722141e75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:02:19.405519 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-3a3639e6-495d-4a3b-b49f-eba7107909d3 tempest-VolumesNegativeTest-2127792717 tempest-VolumesNegativeTest-2127792717-project] 10.222.0.17 "GET /compute/v2.1/servers/ee275bd4-5cd1-46e8-9084-74b027db92fa" status: 200 len: 1314 microversion: 2.1 time: 0.172710 Jun 16 23:02:19.406373 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 122/247] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:02:19 2022] GET /compute/v2.1/servers/ee275bd4-5cd1-46e8-9084-74b027db92fa => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 23:02:20.103943 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-7b5b4a50-5503-43c5-bb77-d8c20f8dcf6e tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:02:20.104541 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-7b5b4a50-5503-43c5-bb77-d8c20f8dcf6e tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] [instance: 4ad3ba60-bc63-4d0a-be00-f9b00e66d803] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:02:20.110549 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-7b5b4a50-5503-43c5-bb77-d8c20f8dcf6e tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:20.111034 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-7b5b4a50-5503-43c5-bb77-d8c20f8dcf6e tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:20.111797 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-7b5b4a50-5503-43c5-bb77-d8c20f8dcf6e tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:20.112235 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-7b5b4a50-5503-43c5-bb77-d8c20f8dcf6e tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:20.248265 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-7b5b4a50-5503-43c5-bb77-d8c20f8dcf6e tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '243e592fbf1844d89f55dd5035a684f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60447df5461141e883d207e028b74bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:02:20.255928 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-7b5b4a50-5503-43c5-bb77-d8c20f8dcf6e tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] 10.222.0.17 "GET /compute/v2.1/servers/4ad3ba60-bc63-4d0a-be00-f9b00e66d803" status: 200 len: 1521 microversion: 2.1 time: 0.156186 Jun 16 23:02:20.256486 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 126/248] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:02:20 2022] GET /compute/v2.1/servers/4ad3ba60-bc63-4d0a-be00-f9b00e66d803 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:02:20.421503 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-ed4a9f39-5002-4bd2-8907-ce31ee04f9d9 tempest-VolumesNegativeTest-2127792717 tempest-VolumesNegativeTest-2127792717-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:02:20.422106 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-ed4a9f39-5002-4bd2-8907-ce31ee04f9d9 tempest-VolumesNegativeTest-2127792717 tempest-VolumesNegativeTest-2127792717-project] [instance: ee275bd4-5cd1-46e8-9084-74b027db92fa] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:02:20.428535 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-ed4a9f39-5002-4bd2-8907-ce31ee04f9d9 tempest-VolumesNegativeTest-2127792717 tempest-VolumesNegativeTest-2127792717-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:20.428986 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-ed4a9f39-5002-4bd2-8907-ce31ee04f9d9 tempest-VolumesNegativeTest-2127792717 tempest-VolumesNegativeTest-2127792717-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:20.429745 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-ed4a9f39-5002-4bd2-8907-ce31ee04f9d9 tempest-VolumesNegativeTest-2127792717 tempest-VolumesNegativeTest-2127792717-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:20.430182 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-ed4a9f39-5002-4bd2-8907-ce31ee04f9d9 tempest-VolumesNegativeTest-2127792717 tempest-VolumesNegativeTest-2127792717-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:20.569933 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-ed4a9f39-5002-4bd2-8907-ce31ee04f9d9 tempest-VolumesNegativeTest-2127792717 tempest-VolumesNegativeTest-2127792717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ee1c54733f648ada66a143ce7516375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90a3d32fe204da7a969528722141e75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:02:20.578511 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-ed4a9f39-5002-4bd2-8907-ce31ee04f9d9 tempest-VolumesNegativeTest-2127792717 tempest-VolumesNegativeTest-2127792717-project] 10.222.0.17 "GET /compute/v2.1/servers/ee275bd4-5cd1-46e8-9084-74b027db92fa" status: 200 len: 1314 microversion: 2.1 time: 0.160761 Jun 16 23:02:20.579463 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 123/249] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:02:20 2022] GET /compute/v2.1/servers/ee275bd4-5cd1-46e8-9084-74b027db92fa => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:02:20.685063 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [req-41914856-23ed-4ecf-b4d0-c57511cdf18c req-e408f008-5e75-485c-98dc-4f8b8ca5789a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee275bd4-5cd1-46e8-9084-74b027db92fa", "name": "network-vif-plugged", "status": "completed", "tag": "a147f1db-e24c-4a2c-885e-59f4a826c62c"}]} {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 23:02:20.693919 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [req-41914856-23ed-4ecf-b4d0-c57511cdf18c req-e408f008-5e75-485c-98dc-4f8b8ca5789a service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:20.695318 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [req-41914856-23ed-4ecf-b4d0-c57511cdf18c req-e408f008-5e75-485c-98dc-4f8b8ca5789a service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:20.708091 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.compute.server_external_events [req-41914856-23ed-4ecf-b4d0-c57511cdf18c req-e408f008-5e75-485c-98dc-4f8b8ca5789a service nova] Creating event network-vif-plugged:a147f1db-e24c-4a2c-885e-59f4a826c62c for instance ee275bd4-5cd1-46e8-9084-74b027db92fa on hv-cinder-84623 Jun 16 23:02:20.714059 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [req-41914856-23ed-4ecf-b4d0-c57511cdf18c req-e408f008-5e75-485c-98dc-4f8b8ca5789a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032384 Jun 16 23:02:20.714668 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 127/250] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 23:02:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 23:02:21.272773 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-7b944e68-92b2-4323-82ad-5445f4a4aecb tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:02:21.273437 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-7b944e68-92b2-4323-82ad-5445f4a4aecb tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] [instance: 4ad3ba60-bc63-4d0a-be00-f9b00e66d803] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:02:21.279860 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-7b944e68-92b2-4323-82ad-5445f4a4aecb tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:21.280338 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-7b944e68-92b2-4323-82ad-5445f4a4aecb tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:21.281108 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-7b944e68-92b2-4323-82ad-5445f4a4aecb tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:21.281561 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-7b944e68-92b2-4323-82ad-5445f4a4aecb tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:21.434351 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-7b944e68-92b2-4323-82ad-5445f4a4aecb tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '243e592fbf1844d89f55dd5035a684f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60447df5461141e883d207e028b74bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:02:21.442936 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-7b944e68-92b2-4323-82ad-5445f4a4aecb tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] 10.222.0.17 "GET /compute/v2.1/servers/4ad3ba60-bc63-4d0a-be00-f9b00e66d803" status: 200 len: 1521 microversion: 2.1 time: 0.174066 Jun 16 23:02:21.443929 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 124/251] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:02:21 2022] GET /compute/v2.1/servers/4ad3ba60-bc63-4d0a-be00-f9b00e66d803 => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:02:21.595529 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-ccf2b902-76ac-42fa-9173-d19432a05dc7 tempest-VolumesNegativeTest-2127792717 tempest-VolumesNegativeTest-2127792717-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:02:21.596218 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-ccf2b902-76ac-42fa-9173-d19432a05dc7 tempest-VolumesNegativeTest-2127792717 tempest-VolumesNegativeTest-2127792717-project] [instance: ee275bd4-5cd1-46e8-9084-74b027db92fa] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:02:21.602885 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-ccf2b902-76ac-42fa-9173-d19432a05dc7 tempest-VolumesNegativeTest-2127792717 tempest-VolumesNegativeTest-2127792717-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:21.603340 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-ccf2b902-76ac-42fa-9173-d19432a05dc7 tempest-VolumesNegativeTest-2127792717 tempest-VolumesNegativeTest-2127792717-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:21.604146 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-ccf2b902-76ac-42fa-9173-d19432a05dc7 tempest-VolumesNegativeTest-2127792717 tempest-VolumesNegativeTest-2127792717-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:21.604617 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-ccf2b902-76ac-42fa-9173-d19432a05dc7 tempest-VolumesNegativeTest-2127792717 tempest-VolumesNegativeTest-2127792717-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:21.732305 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-ccf2b902-76ac-42fa-9173-d19432a05dc7 tempest-VolumesNegativeTest-2127792717 tempest-VolumesNegativeTest-2127792717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ee1c54733f648ada66a143ce7516375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90a3d32fe204da7a969528722141e75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:02:21.740293 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-ccf2b902-76ac-42fa-9173-d19432a05dc7 tempest-VolumesNegativeTest-2127792717 tempest-VolumesNegativeTest-2127792717-project] 10.222.0.17 "GET /compute/v2.1/servers/ee275bd4-5cd1-46e8-9084-74b027db92fa" status: 200 len: 1314 microversion: 2.1 time: 0.148964 Jun 16 23:02:21.740865 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 128/252] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:02:21 2022] GET /compute/v2.1/servers/ee275bd4-5cd1-46e8-9084-74b027db92fa => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:02:22.460405 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-9884d0da-8a1d-4a33-9d5f-23aac49a478b tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:02:22.461008 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-9884d0da-8a1d-4a33-9d5f-23aac49a478b tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] [instance: 4ad3ba60-bc63-4d0a-be00-f9b00e66d803] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:02:22.463029 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG dbcounter [-] [117563] Writing DB stats nova_cell0:SELECT=2 {{(pid=117563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 23:02:22.469452 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-9884d0da-8a1d-4a33-9d5f-23aac49a478b tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:22.470283 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-9884d0da-8a1d-4a33-9d5f-23aac49a478b tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:22.471117 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-9884d0da-8a1d-4a33-9d5f-23aac49a478b tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:22.471854 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-9884d0da-8a1d-4a33-9d5f-23aac49a478b tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:22.521528 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-31bec76d-1ebd-4299-9fce-439f77eec9d0 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1022522587", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-815840424", "security_groups": [{"name": "tempest-secgroup-smoke-526889536"}], "networks": [{"uuid": "9e714880-bad0-4adf-82ee-dc3ffe4b848d"}], "block_device_mapping_v2": [{"uuid": "2b2ee65a-9b49-4981-8d33-50b3ac21ea2d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 23:02:22.529728 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG dbcounter [-] [117562] Writing DB stats nova_cell0:SELECT=2 {{(pid=117562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 23:02:22.530523 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG dbcounter [-] [117562] Writing DB stats nova_cell0:SELECT=6 {{(pid=117562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 23:02:22.531213 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG dbcounter [-] [117562] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=4 {{(pid=117562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 23:02:22.627605 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-9884d0da-8a1d-4a33-9d5f-23aac49a478b tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '243e592fbf1844d89f55dd5035a684f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60447df5461141e883d207e028b74bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:02:22.635876 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-9884d0da-8a1d-4a33-9d5f-23aac49a478b tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] 10.222.0.17 "GET /compute/v2.1/servers/4ad3ba60-bc63-4d0a-be00-f9b00e66d803" status: 200 len: 1501 microversion: 2.1 time: 0.179193 Jun 16 23:02:22.636559 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 125/253] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:02:22 2022] GET /compute/v2.1/servers/4ad3ba60-bc63-4d0a-be00-f9b00e66d803 => generated 1501 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:02:22.652369 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-43f04742-4c10-4835-8066-7ba8aa527308 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a758de65-9c40-4e68-90f1-b6939208b66a"}} {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 23:02:22.653454 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-43f04742-4c10-4835-8066-7ba8aa527308 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] [instance: 4ad3ba60-bc63-4d0a-be00-f9b00e66d803] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:02:22.655536 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.network.neutron [None req-31bec76d-1ebd-4299-9fce-439f77eec9d0 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] validate_networks() for [('9e714880-bad0-4adf-82ee-dc3ffe4b848d', None, None, None, None, None)] {{(pid=117562) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 23:02:22.659677 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-43f04742-4c10-4835-8066-7ba8aa527308 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:22.660129 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-43f04742-4c10-4835-8066-7ba8aa527308 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:22.660899 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-43f04742-4c10-4835-8066-7ba8aa527308 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:22.661332 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-43f04742-4c10-4835-8066-7ba8aa527308 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:22.686636 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.wsgi [None req-43f04742-4c10-4835-8066-7ba8aa527308 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] HTTP exception thrown: Cannot 'attach_volume' instance 4ad3ba60-bc63-4d0a-be00-f9b00e66d803 while it is in vm_state rescued Jun 16 23:02:22.688894 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-43f04742-4c10-4835-8066-7ba8aa527308 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Request method failure captured: Jun 16 23:02:22.688894 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: request: POST /compute/v2.1/servers/4ad3ba60-bc63-4d0a-be00-f9b00e66d803/os-volume_attachments HTTP/1.1 Jun 16 23:02:22.688894 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Accept: application/json Jun 16 23:02:22.688894 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Accept-Encoding: identity Jun 16 23:02:22.688894 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Connection: close Jun 16 23:02:22.688894 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Content-Length: 74 Jun 16 23:02:22.688894 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Content-Type: application/json Jun 16 23:02:22.688894 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Host: 10.222.0.17 Jun 16 23:02:22.688894 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Openstack-System-Scope: None Jun 16 23:02:22.688894 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: User-Agent: python-urllib3/1.26.9 Jun 16 23:02:22.688894 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Auth-Token: gAAAAABiq7Ybpb0QO0FcFn_EOw5P6FTbOHo1mCVh1QS4wC871UGlRsfydiFbvefR_ouEKZbaz8Cp87VYbn--bsc0A8Z56HhTuujXXbcpoO2sA3ojRA0C8Q-lwRF3sq-FBCCjaN6ItRbHJC1L8ezexrcUPCnREK8HUDeFj-L4igPJ9X0jeAiI_Ic Jun 16 23:02:22.688894 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Domain-Id: None Jun 16 23:02:22.688894 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Domain-Name: None Jun 16 23:02:22.688894 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Identity-Status: Confirmed Jun 16 23:02:22.688894 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Is-Admin-Project: True Jun 16 23:02:22.688894 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Project-Domain-Id: default Jun 16 23:02:22.688894 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Project-Domain-Name: Default Jun 16 23:02:22.688894 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Project-Id: 60447df5461141e883d207e028b74bc7 Jun 16 23:02:22.688894 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1782574210 Jun 16 23:02:22.688894 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Role: member,reader Jun 16 23:02:22.688894 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Roles: member,reader Jun 16 23:02:22.690607 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/60447df5461141e883d207e028b74bc7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_60447df5461141e883d207e028b74bc7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/60447df5461141e883d207e028b74bc7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/60447df5461141e883d207e028b74bc7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Jun 16 23:02:22.690607 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1782574210 Jun 16 23:02:22.690607 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Tenant-Id: 60447df5461141e883d207e028b74bc7 Jun 16 23:02:22.690607 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1782574210 Jun 16 23:02:22.690607 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-User: tempest-ServerRescueNegativeTestJSON-1782574210-project Jun 16 23:02:22.690607 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-User-Domain-Id: default Jun 16 23:02:22.690607 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-User-Domain-Name: Default Jun 16 23:02:22.690607 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-User-Id: 243e592fbf1844d89f55dd5035a684f3 Jun 16 23:02:22.690607 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1782574210-project Jun 16 23:02:22.690607 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Jun 16 23:02:22.690607 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: {"volumeAttachment": {"volumeId": "a758de65-9c40-4e68-90f1-b6939208b66a"}} Jun 16 23:02:22.690607 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: method: > Jun 16 23:02:22.691416 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: exception: Cannot 'attach_volume' instance 4ad3ba60-bc63-4d0a-be00-f9b00e66d803 while it is in vm_state rescued Jun 16 23:02:22.691416 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: action_args: {'server_id': '4ad3ba60-bc63-4d0a-be00-f9b00e66d803', 'body': {'volumeAttachment': {'volumeId': 'a758de65-9c40-4e68-90f1-b6939208b66a'}}} Jun 16 23:02:22.691416 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 23:02:22.691416 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 23:02:22.691416 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 16 23:02:22.691416 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 16 23:02:22.691416 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 16 23:02:22.691416 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 16 23:02:22.691416 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 16 23:02:22.691416 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 16 23:02:22.691416 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 4ad3ba60-bc63-4d0a-be00-f9b00e66d803 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jun 16 23:02:22.691416 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 16 23:02:22.691416 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 23:02:22.691416 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 16 23:02:22.691416 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 23:02:22.691416 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 23:02:22.691416 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 23:02:22.691416 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 23:02:22.691416 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 23:02:22.692819 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 23:02:22.692819 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 23:02:22.692819 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 23:02:22.692819 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 23:02:22.692819 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 23:02:22.692819 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 23:02:22.692819 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 23:02:22.692819 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 23:02:22.692819 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jun 16 23:02:22.692819 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 16 23:02:22.692819 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 16 23:02:22.692819 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 16 23:02:22.692819 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 4ad3ba60-bc63-4d0a-be00-f9b00e66d803 while it is in vm_state rescued Jun 16 23:02:22.692819 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 16 23:02:22.692819 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 23:02:22.692819 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 16 23:02:22.692819 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 23:02:22.692819 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 23:02:22.692819 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 23:02:22.693993 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 23:02:22.693993 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 23:02:22.693993 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 4ad3ba60-bc63-4d0a-be00-f9b00e66d803 while it is in vm_state rescued Jun 16 23:02:22.693993 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 16 23:02:22.693993 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-43f04742-4c10-4835-8066-7ba8aa527308 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Returning 409 to user: Cannot 'attach_volume' instance 4ad3ba60-bc63-4d0a-be00-f9b00e66d803 while it is in vm_state rescued {{(pid=117563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 23:02:22.693993 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-43f04742-4c10-4835-8066-7ba8aa527308 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] 10.222.0.17 "POST /compute/v2.1/servers/4ad3ba60-bc63-4d0a-be00-f9b00e66d803/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.042010 Jun 16 23:02:22.693993 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 126/254] 10.222.0.17 () {60 vars in 1322 bytes} [Thu Jun 16 23:02:22 2022] POST /compute/v2.1/servers/4ad3ba60-bc63-4d0a-be00-f9b00e66d803/os-volume_attachments => generated 152 bytes in 43 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jun 16 23:02:22.703668 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-047c4e32-8e66-49a4-9aa8-0519703c83ca tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 23:02:22.704196 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-047c4e32-8e66-49a4-9aa8-0519703c83ca tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] [instance: 4ad3ba60-bc63-4d0a-be00-f9b00e66d803] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:02:22.710349 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-047c4e32-8e66-49a4-9aa8-0519703c83ca tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:22.710850 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-047c4e32-8e66-49a4-9aa8-0519703c83ca tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:22.711651 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-047c4e32-8e66-49a4-9aa8-0519703c83ca tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:22.712124 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-047c4e32-8e66-49a4-9aa8-0519703c83ca tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:22.786578 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-047c4e32-8e66-49a4-9aa8-0519703c83ca tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] 10.222.0.17 "POST /compute/v2.1/servers/4ad3ba60-bc63-4d0a-be00-f9b00e66d803/action" status: 202 len: 0 microversion: 2.1 time: 0.086864 Jun 16 23:02:22.790842 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 127/255] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Jun 16 23:02:22 2022] POST /compute/v2.1/servers/4ad3ba60-bc63-4d0a-be00-f9b00e66d803/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 16 23:02:22.792722 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-45300cdd-fc93-4a2f-be85-1e724bfb5e79 tempest-VolumesNegativeTest-2127792717 tempest-VolumesNegativeTest-2127792717-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:02:22.793752 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-45300cdd-fc93-4a2f-be85-1e724bfb5e79 tempest-VolumesNegativeTest-2127792717 tempest-VolumesNegativeTest-2127792717-project] [instance: ee275bd4-5cd1-46e8-9084-74b027db92fa] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:02:22.800392 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-45300cdd-fc93-4a2f-be85-1e724bfb5e79 tempest-VolumesNegativeTest-2127792717 tempest-VolumesNegativeTest-2127792717-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:22.800857 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-45300cdd-fc93-4a2f-be85-1e724bfb5e79 tempest-VolumesNegativeTest-2127792717 tempest-VolumesNegativeTest-2127792717-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:22.801612 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-45300cdd-fc93-4a2f-be85-1e724bfb5e79 tempest-VolumesNegativeTest-2127792717 tempest-VolumesNegativeTest-2127792717-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:22.802051 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-45300cdd-fc93-4a2f-be85-1e724bfb5e79 tempest-VolumesNegativeTest-2127792717 tempest-VolumesNegativeTest-2127792717-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:23.049378 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-45300cdd-fc93-4a2f-be85-1e724bfb5e79 tempest-VolumesNegativeTest-2127792717 tempest-VolumesNegativeTest-2127792717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ee1c54733f648ada66a143ce7516375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90a3d32fe204da7a969528722141e75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:02:23.059774 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-45300cdd-fc93-4a2f-be85-1e724bfb5e79 tempest-VolumesNegativeTest-2127792717 tempest-VolumesNegativeTest-2127792717-project] 10.222.0.17 "GET /compute/v2.1/servers/ee275bd4-5cd1-46e8-9084-74b027db92fa" status: 200 len: 1314 microversion: 2.1 time: 0.271181 Jun 16 23:02:23.061182 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 128/256] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:02:22 2022] GET /compute/v2.1/servers/ee275bd4-5cd1-46e8-9084-74b027db92fa => generated 1314 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:02:23.066345 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-08b3ba46-f77a-4b35-87b9-39e5ed2e10df tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:02:23.067327 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-08b3ba46-f77a-4b35-87b9-39e5ed2e10df tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] [instance: 4ad3ba60-bc63-4d0a-be00-f9b00e66d803] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:02:23.075192 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-08b3ba46-f77a-4b35-87b9-39e5ed2e10df tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:23.075943 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-08b3ba46-f77a-4b35-87b9-39e5ed2e10df tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:23.076967 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-08b3ba46-f77a-4b35-87b9-39e5ed2e10df tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:23.077594 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-08b3ba46-f77a-4b35-87b9-39e5ed2e10df tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:23.239603 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.virt.hardware [None req-31bec76d-1ebd-4299-9fce-439f77eec9d0 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Flavor limits 0:0:0 {{(pid=117562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 23:02:23.240025 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.virt.hardware [None req-31bec76d-1ebd-4299-9fce-439f77eec9d0 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Image limits 0:0:0 {{(pid=117562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 23:02:23.240519 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.virt.hardware [None req-31bec76d-1ebd-4299-9fce-439f77eec9d0 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Flavor pref 0:0:0 {{(pid=117562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 23:02:23.240953 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.virt.hardware [None req-31bec76d-1ebd-4299-9fce-439f77eec9d0 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Image pref 0:0:0 {{(pid=117562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 23:02:23.241364 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.virt.hardware [None req-31bec76d-1ebd-4299-9fce-439f77eec9d0 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 23:02:23.262324 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-31bec76d-1ebd-4299-9fce-439f77eec9d0 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:23.263496 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-31bec76d-1ebd-4299-9fce-439f77eec9d0 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:23.264496 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-31bec76d-1ebd-4299-9fce-439f77eec9d0 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:23.265196 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-31bec76d-1ebd-4299-9fce-439f77eec9d0 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:23.285033 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.quota [None req-31bec76d-1ebd-4299-9fce-439f77eec9d0 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Getting quotas for project b30b90ec4d5e45468a4fa0fb98e46393. Resources: {'instances', 'cores', 'ram'} {{(pid=117562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 23:02:23.285712 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-08b3ba46-f77a-4b35-87b9-39e5ed2e10df tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '243e592fbf1844d89f55dd5035a684f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60447df5461141e883d207e028b74bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:02:23.289892 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.quota [None req-31bec76d-1ebd-4299-9fce-439f77eec9d0 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Getting quotas for user 01dd0e5661f44d05a01d7a5e82dbadf3 and project b30b90ec4d5e45468a4fa0fb98e46393. Resources: {'instances', 'cores', 'ram'} {{(pid=117562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 23:02:23.293498 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-08b3ba46-f77a-4b35-87b9-39e5ed2e10df tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] 10.222.0.17 "GET /compute/v2.1/servers/4ad3ba60-bc63-4d0a-be00-f9b00e66d803" status: 200 len: 1509 microversion: 2.1 time: 0.231184 Jun 16 23:02:23.294233 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 129/257] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:02:23 2022] GET /compute/v2.1/servers/4ad3ba60-bc63-4d0a-be00-f9b00e66d803 => generated 1509 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:02:23.349026 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-31bec76d-1ebd-4299-9fce-439f77eec9d0 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Going to run 1 instances... {{(pid=117562) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 23:02:23.351402 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-31bec76d-1ebd-4299-9fce-439f77eec9d0 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] [instance: aa81794d-bc81-49d2-b4dc-6f57b43ecfe8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2b2ee65a-9b49-4981-8d33-50b3ac21ea2d',volume_size=None,volume_type=None)] {{(pid=117562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 23:02:23.483031 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-31bec76d-1ebd-4299-9fce-439f77eec9d0 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.965445 Jun 16 23:02:23.483685 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 129/258] 10.222.0.17 () {60 vars in 1146 bytes} [Thu Jun 16 23:02:22 2022] POST /compute/v2.1/servers => generated 405 bytes in 967 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 23:02:23.493589 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-3f792e68-1a57-40c1-9a2b-7011624dc64d tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:02:23.494078 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-3f792e68-1a57-40c1-9a2b-7011624dc64d tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] [instance: aa81794d-bc81-49d2-b4dc-6f57b43ecfe8] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:02:23.558657 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-3f792e68-1a57-40c1-9a2b-7011624dc64d tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01dd0e5661f44d05a01d7a5e82dbadf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b30b90ec4d5e45468a4fa0fb98e46393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:02:23.570772 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-3f792e68-1a57-40c1-9a2b-7011624dc64d tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] 10.222.0.17 "GET /compute/v2.1/servers/aa81794d-bc81-49d2-b4dc-6f57b43ecfe8" status: 200 len: 1088 microversion: 2.1 time: 0.079591 Jun 16 23:02:23.570772 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 130/259] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:02:23 2022] GET /compute/v2.1/servers/aa81794d-bc81-49d2-b4dc-6f57b43ecfe8 => generated 1088 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:02:24.077318 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-18480d41-f411-4420-aab5-9502c479f408 tempest-VolumesNegativeTest-2127792717 tempest-VolumesNegativeTest-2127792717-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:02:24.077995 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-18480d41-f411-4420-aab5-9502c479f408 tempest-VolumesNegativeTest-2127792717 tempest-VolumesNegativeTest-2127792717-project] [instance: ee275bd4-5cd1-46e8-9084-74b027db92fa] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:02:24.086141 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-18480d41-f411-4420-aab5-9502c479f408 tempest-VolumesNegativeTest-2127792717 tempest-VolumesNegativeTest-2127792717-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:24.086622 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-18480d41-f411-4420-aab5-9502c479f408 tempest-VolumesNegativeTest-2127792717 tempest-VolumesNegativeTest-2127792717-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:24.087617 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-18480d41-f411-4420-aab5-9502c479f408 tempest-VolumesNegativeTest-2127792717 tempest-VolumesNegativeTest-2127792717-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:24.088124 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-18480d41-f411-4420-aab5-9502c479f408 tempest-VolumesNegativeTest-2127792717 tempest-VolumesNegativeTest-2127792717-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:24.311759 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-a6395abf-f317-4149-9b94-8f0a4f27d4d5 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:02:24.312607 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-a6395abf-f317-4149-9b94-8f0a4f27d4d5 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] [instance: 4ad3ba60-bc63-4d0a-be00-f9b00e66d803] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:02:24.318520 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-a6395abf-f317-4149-9b94-8f0a4f27d4d5 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:24.319006 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-a6395abf-f317-4149-9b94-8f0a4f27d4d5 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:24.319776 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-a6395abf-f317-4149-9b94-8f0a4f27d4d5 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:24.320217 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-a6395abf-f317-4149-9b94-8f0a4f27d4d5 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:24.352322 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-18480d41-f411-4420-aab5-9502c479f408 tempest-VolumesNegativeTest-2127792717 tempest-VolumesNegativeTest-2127792717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ee1c54733f648ada66a143ce7516375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90a3d32fe204da7a969528722141e75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:02:24.360615 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-18480d41-f411-4420-aab5-9502c479f408 tempest-VolumesNegativeTest-2127792717 tempest-VolumesNegativeTest-2127792717-project] 10.222.0.17 "GET /compute/v2.1/servers/ee275bd4-5cd1-46e8-9084-74b027db92fa" status: 200 len: 1464 microversion: 2.1 time: 0.287241 Jun 16 23:02:24.361460 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 130/260] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:02:24 2022] GET /compute/v2.1/servers/ee275bd4-5cd1-46e8-9084-74b027db92fa => generated 1464 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 23:02:24.399401 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-3711ee7d-24fa-4a5c-8e0a-614e06c60f96 tempest-VolumesNegativeTest-2127792717 tempest-VolumesNegativeTest-2127792717-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:02:24.400123 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-3711ee7d-24fa-4a5c-8e0a-614e06c60f96 tempest-VolumesNegativeTest-2127792717 tempest-VolumesNegativeTest-2127792717-project] [instance: ee275bd4-5cd1-46e8-9084-74b027db92fa] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:02:24.406669 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-3711ee7d-24fa-4a5c-8e0a-614e06c60f96 tempest-VolumesNegativeTest-2127792717 tempest-VolumesNegativeTest-2127792717-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:24.407118 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-3711ee7d-24fa-4a5c-8e0a-614e06c60f96 tempest-VolumesNegativeTest-2127792717 tempest-VolumesNegativeTest-2127792717-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:24.407870 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-3711ee7d-24fa-4a5c-8e0a-614e06c60f96 tempest-VolumesNegativeTest-2127792717 tempest-VolumesNegativeTest-2127792717-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:24.408332 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-3711ee7d-24fa-4a5c-8e0a-614e06c60f96 tempest-VolumesNegativeTest-2127792717 tempest-VolumesNegativeTest-2127792717-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:24.434573 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-3711ee7d-24fa-4a5c-8e0a-614e06c60f96 tempest-VolumesNegativeTest-2127792717 tempest-VolumesNegativeTest-2127792717-project] [instance: ee275bd4-5cd1-46e8-9084-74b027db92fa] Going to try to terminate instance {{(pid=117562) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 23:02:24.437852 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG dbcounter [-] [117562] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 23:02:24.453331 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-a6395abf-f317-4149-9b94-8f0a4f27d4d5 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '243e592fbf1844d89f55dd5035a684f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60447df5461141e883d207e028b74bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:02:24.472505 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-a6395abf-f317-4149-9b94-8f0a4f27d4d5 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] 10.222.0.17 "GET /compute/v2.1/servers/4ad3ba60-bc63-4d0a-be00-f9b00e66d803" status: 200 len: 1509 microversion: 2.1 time: 0.164762 Jun 16 23:02:24.482732 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 131/261] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:02:24 2022] GET /compute/v2.1/servers/4ad3ba60-bc63-4d0a-be00-f9b00e66d803 => generated 1509 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 23:02:24.546502 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-3711ee7d-24fa-4a5c-8e0a-614e06c60f96 tempest-VolumesNegativeTest-2127792717 tempest-VolumesNegativeTest-2127792717-project] 10.222.0.17 "DELETE /compute/v2.1/servers/ee275bd4-5cd1-46e8-9084-74b027db92fa" status: 204 len: 0 microversion: 2.1 time: 0.150476 Jun 16 23:02:24.547176 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 131/262] 10.222.0.17 () {58 vars in 1238 bytes} [Thu Jun 16 23:02:24 2022] DELETE /compute/v2.1/servers/ee275bd4-5cd1-46e8-9084-74b027db92fa => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 16 23:02:24.555117 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-d1affe25-c9d7-4c9f-b7f4-7bb3c853b30c tempest-VolumesNegativeTest-2127792717 tempest-VolumesNegativeTest-2127792717-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:02:24.555726 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-d1affe25-c9d7-4c9f-b7f4-7bb3c853b30c tempest-VolumesNegativeTest-2127792717 tempest-VolumesNegativeTest-2127792717-project] [instance: ee275bd4-5cd1-46e8-9084-74b027db92fa] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:02:24.562270 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-d1affe25-c9d7-4c9f-b7f4-7bb3c853b30c tempest-VolumesNegativeTest-2127792717 tempest-VolumesNegativeTest-2127792717-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:24.562755 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-d1affe25-c9d7-4c9f-b7f4-7bb3c853b30c tempest-VolumesNegativeTest-2127792717 tempest-VolumesNegativeTest-2127792717-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:24.563522 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-d1affe25-c9d7-4c9f-b7f4-7bb3c853b30c tempest-VolumesNegativeTest-2127792717 tempest-VolumesNegativeTest-2127792717-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:24.563954 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-d1affe25-c9d7-4c9f-b7f4-7bb3c853b30c tempest-VolumesNegativeTest-2127792717 tempest-VolumesNegativeTest-2127792717-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:24.589916 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-6736a5d9-1081-4044-9353-9fa5ff774318 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:02:24.590730 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-6736a5d9-1081-4044-9353-9fa5ff774318 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] [instance: aa81794d-bc81-49d2-b4dc-6f57b43ecfe8] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:02:24.597028 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-6736a5d9-1081-4044-9353-9fa5ff774318 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:24.597560 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-6736a5d9-1081-4044-9353-9fa5ff774318 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:24.598332 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-6736a5d9-1081-4044-9353-9fa5ff774318 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:24.598794 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-6736a5d9-1081-4044-9353-9fa5ff774318 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:24.687949 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-6736a5d9-1081-4044-9353-9fa5ff774318 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01dd0e5661f44d05a01d7a5e82dbadf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b30b90ec4d5e45468a4fa0fb98e46393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:02:24.704452 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-6736a5d9-1081-4044-9353-9fa5ff774318 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] 10.222.0.17 "GET /compute/v2.1/servers/aa81794d-bc81-49d2-b4dc-6f57b43ecfe8" status: 200 len: 1194 microversion: 2.1 time: 0.118379 Jun 16 23:02:24.707033 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 132/263] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:02:24 2022] GET /compute/v2.1/servers/aa81794d-bc81-49d2-b4dc-6f57b43ecfe8 => generated 1194 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:02:24.738008 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-d1affe25-c9d7-4c9f-b7f4-7bb3c853b30c tempest-VolumesNegativeTest-2127792717 tempest-VolumesNegativeTest-2127792717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ee1c54733f648ada66a143ce7516375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90a3d32fe204da7a969528722141e75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:02:24.746401 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-d1affe25-c9d7-4c9f-b7f4-7bb3c853b30c tempest-VolumesNegativeTest-2127792717 tempest-VolumesNegativeTest-2127792717-project] 10.222.0.17 "GET /compute/v2.1/servers/ee275bd4-5cd1-46e8-9084-74b027db92fa" status: 200 len: 1470 microversion: 2.1 time: 0.195113 Jun 16 23:02:24.747063 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 132/264] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:02:24 2022] GET /compute/v2.1/servers/ee275bd4-5cd1-46e8-9084-74b027db92fa => generated 1470 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:02:25.490435 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-e02aaa70-4f97-49cc-b0bc-41afc1993fbe tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:02:25.490976 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-e02aaa70-4f97-49cc-b0bc-41afc1993fbe tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] [instance: 4ad3ba60-bc63-4d0a-be00-f9b00e66d803] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:02:25.499231 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-e02aaa70-4f97-49cc-b0bc-41afc1993fbe tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:25.499682 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-e02aaa70-4f97-49cc-b0bc-41afc1993fbe tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:25.500894 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-e02aaa70-4f97-49cc-b0bc-41afc1993fbe tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:25.501696 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-e02aaa70-4f97-49cc-b0bc-41afc1993fbe tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:25.632038 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-e02aaa70-4f97-49cc-b0bc-41afc1993fbe tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '243e592fbf1844d89f55dd5035a684f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60447df5461141e883d207e028b74bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:02:25.639856 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-e02aaa70-4f97-49cc-b0bc-41afc1993fbe tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] 10.222.0.17 "GET /compute/v2.1/servers/4ad3ba60-bc63-4d0a-be00-f9b00e66d803" status: 200 len: 1509 microversion: 2.1 time: 0.153376 Jun 16 23:02:25.640417 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 133/265] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:02:25 2022] GET /compute/v2.1/servers/4ad3ba60-bc63-4d0a-be00-f9b00e66d803 => generated 1509 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:02:25.721835 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-b1cd442a-6bf5-426a-b4a5-504f02a7d063 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:02:25.722451 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-b1cd442a-6bf5-426a-b4a5-504f02a7d063 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] [instance: aa81794d-bc81-49d2-b4dc-6f57b43ecfe8] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:02:25.729255 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-b1cd442a-6bf5-426a-b4a5-504f02a7d063 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:25.729705 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-b1cd442a-6bf5-426a-b4a5-504f02a7d063 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:25.730464 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-b1cd442a-6bf5-426a-b4a5-504f02a7d063 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:25.730928 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-b1cd442a-6bf5-426a-b4a5-504f02a7d063 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:25.764045 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-480f78c1-a8c2-4cbf-bf0c-3fbc30ab6e13 tempest-VolumesNegativeTest-2127792717 tempest-VolumesNegativeTest-2127792717-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:02:25.764673 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-480f78c1-a8c2-4cbf-bf0c-3fbc30ab6e13 tempest-VolumesNegativeTest-2127792717 tempest-VolumesNegativeTest-2127792717-project] [instance: ee275bd4-5cd1-46e8-9084-74b027db92fa] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:02:25.770794 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-480f78c1-a8c2-4cbf-bf0c-3fbc30ab6e13 tempest-VolumesNegativeTest-2127792717 tempest-VolumesNegativeTest-2127792717-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:25.771254 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-480f78c1-a8c2-4cbf-bf0c-3fbc30ab6e13 tempest-VolumesNegativeTest-2127792717 tempest-VolumesNegativeTest-2127792717-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:25.772032 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-480f78c1-a8c2-4cbf-bf0c-3fbc30ab6e13 tempest-VolumesNegativeTest-2127792717 tempest-VolumesNegativeTest-2127792717-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:25.772473 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-480f78c1-a8c2-4cbf-bf0c-3fbc30ab6e13 tempest-VolumesNegativeTest-2127792717 tempest-VolumesNegativeTest-2127792717-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:25.793792 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-b1cd442a-6bf5-426a-b4a5-504f02a7d063 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01dd0e5661f44d05a01d7a5e82dbadf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b30b90ec4d5e45468a4fa0fb98e46393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:02:25.804183 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-b1cd442a-6bf5-426a-b4a5-504f02a7d063 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] 10.222.0.17 "GET /compute/v2.1/servers/aa81794d-bc81-49d2-b4dc-6f57b43ecfe8" status: 200 len: 1194 microversion: 2.1 time: 0.086076 Jun 16 23:02:25.804769 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 133/266] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:02:25 2022] GET /compute/v2.1/servers/aa81794d-bc81-49d2-b4dc-6f57b43ecfe8 => generated 1194 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:02:25.902947 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-480f78c1-a8c2-4cbf-bf0c-3fbc30ab6e13 tempest-VolumesNegativeTest-2127792717 tempest-VolumesNegativeTest-2127792717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ee1c54733f648ada66a143ce7516375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90a3d32fe204da7a969528722141e75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:02:25.910220 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-480f78c1-a8c2-4cbf-bf0c-3fbc30ab6e13 tempest-VolumesNegativeTest-2127792717 tempest-VolumesNegativeTest-2127792717-project] 10.222.0.17 "GET /compute/v2.1/servers/ee275bd4-5cd1-46e8-9084-74b027db92fa" status: 200 len: 1470 microversion: 2.1 time: 0.150502 Jun 16 23:02:25.910814 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 134/267] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:02:25 2022] GET /compute/v2.1/servers/ee275bd4-5cd1-46e8-9084-74b027db92fa => generated 1470 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 23:02:26.656511 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-8dfcd607-7e6e-4167-83e5-05c12779d9ce tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:02:26.657116 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-8dfcd607-7e6e-4167-83e5-05c12779d9ce tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] [instance: 4ad3ba60-bc63-4d0a-be00-f9b00e66d803] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:02:26.663204 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-8dfcd607-7e6e-4167-83e5-05c12779d9ce tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:26.663658 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-8dfcd607-7e6e-4167-83e5-05c12779d9ce tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:26.664426 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-8dfcd607-7e6e-4167-83e5-05c12779d9ce tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:26.664925 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-8dfcd607-7e6e-4167-83e5-05c12779d9ce tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:26.797143 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-8dfcd607-7e6e-4167-83e5-05c12779d9ce tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '243e592fbf1844d89f55dd5035a684f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60447df5461141e883d207e028b74bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:02:26.800676 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG dbcounter [-] [117563] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 23:02:26.805569 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-8dfcd607-7e6e-4167-83e5-05c12779d9ce tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] 10.222.0.17 "GET /compute/v2.1/servers/4ad3ba60-bc63-4d0a-be00-f9b00e66d803" status: 200 len: 1509 microversion: 2.1 time: 0.152858 Jun 16 23:02:26.806148 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 134/268] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:02:26 2022] GET /compute/v2.1/servers/4ad3ba60-bc63-4d0a-be00-f9b00e66d803 => generated 1509 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:02:26.820508 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-92a7ea0f-d309-4ccf-bc4a-7db70dd2a024 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:02:26.821115 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-92a7ea0f-d309-4ccf-bc4a-7db70dd2a024 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] [instance: aa81794d-bc81-49d2-b4dc-6f57b43ecfe8] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:02:26.827925 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-92a7ea0f-d309-4ccf-bc4a-7db70dd2a024 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:26.828376 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-92a7ea0f-d309-4ccf-bc4a-7db70dd2a024 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:26.829141 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-92a7ea0f-d309-4ccf-bc4a-7db70dd2a024 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:26.829583 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-92a7ea0f-d309-4ccf-bc4a-7db70dd2a024 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:26.892179 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-92a7ea0f-d309-4ccf-bc4a-7db70dd2a024 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01dd0e5661f44d05a01d7a5e82dbadf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b30b90ec4d5e45468a4fa0fb98e46393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:02:26.899629 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-92a7ea0f-d309-4ccf-bc4a-7db70dd2a024 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] 10.222.0.17 "GET /compute/v2.1/servers/aa81794d-bc81-49d2-b4dc-6f57b43ecfe8" status: 200 len: 1194 microversion: 2.1 time: 0.083143 Jun 16 23:02:26.900192 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 135/269] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:02:26 2022] GET /compute/v2.1/servers/aa81794d-bc81-49d2-b4dc-6f57b43ecfe8 => generated 1194 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 23:02:26.928925 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-0149bab1-d9a0-4881-ad8d-eec78c90ddd1 tempest-VolumesNegativeTest-2127792717 tempest-VolumesNegativeTest-2127792717-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:02:26.929626 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-0149bab1-d9a0-4881-ad8d-eec78c90ddd1 tempest-VolumesNegativeTest-2127792717 tempest-VolumesNegativeTest-2127792717-project] [instance: ee275bd4-5cd1-46e8-9084-74b027db92fa] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:02:26.937726 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-0149bab1-d9a0-4881-ad8d-eec78c90ddd1 tempest-VolumesNegativeTest-2127792717 tempest-VolumesNegativeTest-2127792717-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:26.938178 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-0149bab1-d9a0-4881-ad8d-eec78c90ddd1 tempest-VolumesNegativeTest-2127792717 tempest-VolumesNegativeTest-2127792717-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:26.938981 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-0149bab1-d9a0-4881-ad8d-eec78c90ddd1 tempest-VolumesNegativeTest-2127792717 tempest-VolumesNegativeTest-2127792717-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:26.939427 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-0149bab1-d9a0-4881-ad8d-eec78c90ddd1 tempest-VolumesNegativeTest-2127792717 tempest-VolumesNegativeTest-2127792717-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:27.090371 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-0149bab1-d9a0-4881-ad8d-eec78c90ddd1 tempest-VolumesNegativeTest-2127792717 tempest-VolumesNegativeTest-2127792717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ee1c54733f648ada66a143ce7516375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90a3d32fe204da7a969528722141e75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:02:27.098250 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-0149bab1-d9a0-4881-ad8d-eec78c90ddd1 tempest-VolumesNegativeTest-2127792717 tempest-VolumesNegativeTest-2127792717-project] 10.222.0.17 "GET /compute/v2.1/servers/ee275bd4-5cd1-46e8-9084-74b027db92fa" status: 200 len: 1470 microversion: 2.1 time: 0.174431 Jun 16 23:02:27.098881 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 135/270] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:02:26 2022] GET /compute/v2.1/servers/ee275bd4-5cd1-46e8-9084-74b027db92fa => generated 1470 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:02:27.825676 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-5f30cbc3-3b37-4ae3-b62d-3b4c9ae5fe0c tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:02:27.827822 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-5f30cbc3-3b37-4ae3-b62d-3b4c9ae5fe0c tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] [instance: 4ad3ba60-bc63-4d0a-be00-f9b00e66d803] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:02:27.837040 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-5f30cbc3-3b37-4ae3-b62d-3b4c9ae5fe0c tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:27.838709 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-5f30cbc3-3b37-4ae3-b62d-3b4c9ae5fe0c tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:27.839752 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-5f30cbc3-3b37-4ae3-b62d-3b4c9ae5fe0c tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:27.840680 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-5f30cbc3-3b37-4ae3-b62d-3b4c9ae5fe0c tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:27.915512 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-f1f872e2-78eb-496c-8f64-5f83e0a91900 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:02:27.916157 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-f1f872e2-78eb-496c-8f64-5f83e0a91900 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] [instance: aa81794d-bc81-49d2-b4dc-6f57b43ecfe8] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:02:27.922662 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-f1f872e2-78eb-496c-8f64-5f83e0a91900 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:27.923123 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-f1f872e2-78eb-496c-8f64-5f83e0a91900 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:27.923900 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-f1f872e2-78eb-496c-8f64-5f83e0a91900 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:27.924344 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-f1f872e2-78eb-496c-8f64-5f83e0a91900 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:28.004021 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-f1f872e2-78eb-496c-8f64-5f83e0a91900 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01dd0e5661f44d05a01d7a5e82dbadf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b30b90ec4d5e45468a4fa0fb98e46393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:02:28.029858 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-f1f872e2-78eb-496c-8f64-5f83e0a91900 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] 10.222.0.17 "GET /compute/v2.1/servers/aa81794d-bc81-49d2-b4dc-6f57b43ecfe8" status: 200 len: 1204 microversion: 2.1 time: 0.118261 Jun 16 23:02:28.040411 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 136/271] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:02:27 2022] GET /compute/v2.1/servers/aa81794d-bc81-49d2-b4dc-6f57b43ecfe8 => generated 1204 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 23:02:28.058333 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-5f30cbc3-3b37-4ae3-b62d-3b4c9ae5fe0c tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '243e592fbf1844d89f55dd5035a684f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60447df5461141e883d207e028b74bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:02:28.068184 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-5f30cbc3-3b37-4ae3-b62d-3b4c9ae5fe0c tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] 10.222.0.17 "GET /compute/v2.1/servers/4ad3ba60-bc63-4d0a-be00-f9b00e66d803" status: 200 len: 1509 microversion: 2.1 time: 0.247488 Jun 16 23:02:28.070627 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 136/272] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:02:27 2022] GET /compute/v2.1/servers/4ad3ba60-bc63-4d0a-be00-f9b00e66d803 => generated 1509 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:02:28.115907 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-1849ce50-48d0-4ec3-b269-8896570b54a4 tempest-VolumesNegativeTest-2127792717 tempest-VolumesNegativeTest-2127792717-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:02:28.116844 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-1849ce50-48d0-4ec3-b269-8896570b54a4 tempest-VolumesNegativeTest-2127792717 tempest-VolumesNegativeTest-2127792717-project] [instance: ee275bd4-5cd1-46e8-9084-74b027db92fa] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:02:28.124009 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-1849ce50-48d0-4ec3-b269-8896570b54a4 tempest-VolumesNegativeTest-2127792717 tempest-VolumesNegativeTest-2127792717-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:28.124484 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-1849ce50-48d0-4ec3-b269-8896570b54a4 tempest-VolumesNegativeTest-2127792717 tempest-VolumesNegativeTest-2127792717-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:28.125321 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-1849ce50-48d0-4ec3-b269-8896570b54a4 tempest-VolumesNegativeTest-2127792717 tempest-VolumesNegativeTest-2127792717-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:28.125686 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-1849ce50-48d0-4ec3-b269-8896570b54a4 tempest-VolumesNegativeTest-2127792717 tempest-VolumesNegativeTest-2127792717-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:28.273054 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-1849ce50-48d0-4ec3-b269-8896570b54a4 tempest-VolumesNegativeTest-2127792717 tempest-VolumesNegativeTest-2127792717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ee1c54733f648ada66a143ce7516375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90a3d32fe204da7a969528722141e75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:02:28.281410 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-1849ce50-48d0-4ec3-b269-8896570b54a4 tempest-VolumesNegativeTest-2127792717 tempest-VolumesNegativeTest-2127792717-project] 10.222.0.17 "GET /compute/v2.1/servers/ee275bd4-5cd1-46e8-9084-74b027db92fa" status: 200 len: 1470 microversion: 2.1 time: 0.169487 Jun 16 23:02:28.281983 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 137/273] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:02:28 2022] GET /compute/v2.1/servers/ee275bd4-5cd1-46e8-9084-74b027db92fa => generated 1470 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:02:29.048202 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-9632f86a-ca77-44ab-a7ba-a58b6f656ca3 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:02:29.050166 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-9632f86a-ca77-44ab-a7ba-a58b6f656ca3 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] [instance: aa81794d-bc81-49d2-b4dc-6f57b43ecfe8] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:02:29.061534 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-9632f86a-ca77-44ab-a7ba-a58b6f656ca3 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:29.061534 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-9632f86a-ca77-44ab-a7ba-a58b6f656ca3 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:29.061534 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-9632f86a-ca77-44ab-a7ba-a58b6f656ca3 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:29.061534 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-9632f86a-ca77-44ab-a7ba-a58b6f656ca3 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:29.090854 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-4f782c91-d6dd-49c1-bbd9-6afddd66fbac tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:02:29.091483 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-4f782c91-d6dd-49c1-bbd9-6afddd66fbac tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] [instance: 4ad3ba60-bc63-4d0a-be00-f9b00e66d803] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:02:29.100344 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-4f782c91-d6dd-49c1-bbd9-6afddd66fbac tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:29.101055 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-4f782c91-d6dd-49c1-bbd9-6afddd66fbac tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:29.102235 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-4f782c91-d6dd-49c1-bbd9-6afddd66fbac tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:29.102812 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-4f782c91-d6dd-49c1-bbd9-6afddd66fbac tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:29.535983 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-9632f86a-ca77-44ab-a7ba-a58b6f656ca3 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01dd0e5661f44d05a01d7a5e82dbadf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b30b90ec4d5e45468a4fa0fb98e46393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:02:29.548056 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-9632f86a-ca77-44ab-a7ba-a58b6f656ca3 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] 10.222.0.17 "GET /compute/v2.1/servers/aa81794d-bc81-49d2-b4dc-6f57b43ecfe8" status: 200 len: 1259 microversion: 2.1 time: 0.504392 Jun 16 23:02:29.558316 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 137/274] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:02:29 2022] GET /compute/v2.1/servers/aa81794d-bc81-49d2-b4dc-6f57b43ecfe8 => generated 1259 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:02:29.566435 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-1a16cc80-8a50-41c6-9948-0c6d3e34db14 tempest-VolumesNegativeTest-2127792717 tempest-VolumesNegativeTest-2127792717-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:02:29.567092 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-1a16cc80-8a50-41c6-9948-0c6d3e34db14 tempest-VolumesNegativeTest-2127792717 tempest-VolumesNegativeTest-2127792717-project] [instance: ee275bd4-5cd1-46e8-9084-74b027db92fa] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:02:29.579314 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-1a16cc80-8a50-41c6-9948-0c6d3e34db14 tempest-VolumesNegativeTest-2127792717 tempest-VolumesNegativeTest-2127792717-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:29.580059 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-1a16cc80-8a50-41c6-9948-0c6d3e34db14 tempest-VolumesNegativeTest-2127792717 tempest-VolumesNegativeTest-2127792717-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:29.581520 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-1a16cc80-8a50-41c6-9948-0c6d3e34db14 tempest-VolumesNegativeTest-2127792717 tempest-VolumesNegativeTest-2127792717-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:29.582256 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-1a16cc80-8a50-41c6-9948-0c6d3e34db14 tempest-VolumesNegativeTest-2127792717 tempest-VolumesNegativeTest-2127792717-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:29.591085 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-4f782c91-d6dd-49c1-bbd9-6afddd66fbac tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '243e592fbf1844d89f55dd5035a684f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60447df5461141e883d207e028b74bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:02:29.602662 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-4f782c91-d6dd-49c1-bbd9-6afddd66fbac tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] 10.222.0.17 "GET /compute/v2.1/servers/4ad3ba60-bc63-4d0a-be00-f9b00e66d803" status: 200 len: 1515 microversion: 2.1 time: 0.520536 Jun 16 23:02:29.609080 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 138/275] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:02:29 2022] GET /compute/v2.1/servers/4ad3ba60-bc63-4d0a-be00-f9b00e66d803 => generated 1515 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:02:29.614018 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [req-9a302f3f-15f5-4014-b1f2-fa145f63dfdc req-307d4aea-2146-4918-aa59-3bb05b119fd8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee275bd4-5cd1-46e8-9084-74b027db92fa", "name": "network-vif-deleted", "tag": "a147f1db-e24c-4a2c-885e-59f4a826c62c"}]} {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 23:02:29.634012 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-9a302f3f-15f5-4014-b1f2-fa145f63dfdc req-307d4aea-2146-4918-aa59-3bb05b119fd8 service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:29.634526 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-9a302f3f-15f5-4014-b1f2-fa145f63dfdc req-307d4aea-2146-4918-aa59-3bb05b119fd8 service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:29.661727 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.compute.server_external_events [req-9a302f3f-15f5-4014-b1f2-fa145f63dfdc req-307d4aea-2146-4918-aa59-3bb05b119fd8 service nova] Creating event network-vif-deleted:a147f1db-e24c-4a2c-885e-59f4a826c62c for instance ee275bd4-5cd1-46e8-9084-74b027db92fa on hv-cinder-84623 Jun 16 23:02:29.667439 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-1a16cc80-8a50-41c6-9948-0c6d3e34db14 tempest-VolumesNegativeTest-2127792717 tempest-VolumesNegativeTest-2127792717-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:29.668210 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-1a16cc80-8a50-41c6-9948-0c6d3e34db14 tempest-VolumesNegativeTest-2127792717 tempest-VolumesNegativeTest-2127792717-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:29.668515 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.objects.instance [None req-1a16cc80-8a50-41c6-9948-0c6d3e34db14 tempest-VolumesNegativeTest-2127792717 tempest-VolumesNegativeTest-2127792717-project] Lazy-loading 'fault' on Instance uuid ee275bd4-5cd1-46e8-9084-74b027db92fa {{(pid=117562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 23:02:29.676414 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [req-9a302f3f-15f5-4014-b1f2-fa145f63dfdc req-307d4aea-2146-4918-aa59-3bb05b119fd8 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061139 Jun 16 23:02:29.677512 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 139/276] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 23:02:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 23:02:29.735375 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-1a16cc80-8a50-41c6-9948-0c6d3e34db14 tempest-VolumesNegativeTest-2127792717 tempest-VolumesNegativeTest-2127792717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ee1c54733f648ada66a143ce7516375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90a3d32fe204da7a969528722141e75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:02:29.744282 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-1a16cc80-8a50-41c6-9948-0c6d3e34db14 tempest-VolumesNegativeTest-2127792717 tempest-VolumesNegativeTest-2127792717-project] 10.222.0.17 "GET /compute/v2.1/servers/ee275bd4-5cd1-46e8-9084-74b027db92fa" status: 200 len: 1304 microversion: 2.1 time: 0.184753 Jun 16 23:02:29.754295 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 138/277] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:02:29 2022] GET /compute/v2.1/servers/ee275bd4-5cd1-46e8-9084-74b027db92fa => generated 1304 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:02:30.566404 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-ce743c41-cd65-4f6e-b1d6-21491d7b8fcc tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:02:30.567124 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-ce743c41-cd65-4f6e-b1d6-21491d7b8fcc tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] [instance: aa81794d-bc81-49d2-b4dc-6f57b43ecfe8] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:02:30.573276 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-ce743c41-cd65-4f6e-b1d6-21491d7b8fcc tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:30.573720 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-ce743c41-cd65-4f6e-b1d6-21491d7b8fcc tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:30.574466 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-ce743c41-cd65-4f6e-b1d6-21491d7b8fcc tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:30.574930 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-ce743c41-cd65-4f6e-b1d6-21491d7b8fcc tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:30.709182 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-ce743c41-cd65-4f6e-b1d6-21491d7b8fcc tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01dd0e5661f44d05a01d7a5e82dbadf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b30b90ec4d5e45468a4fa0fb98e46393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:02:30.717136 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-ce743c41-cd65-4f6e-b1d6-21491d7b8fcc tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] 10.222.0.17 "GET /compute/v2.1/servers/aa81794d-bc81-49d2-b4dc-6f57b43ecfe8" status: 200 len: 1259 microversion: 2.1 time: 0.155328 Jun 16 23:02:30.717684 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 140/278] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:02:30 2022] GET /compute/v2.1/servers/aa81794d-bc81-49d2-b4dc-6f57b43ecfe8 => generated 1259 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 23:02:30.761563 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-f7bb057f-bd55-4132-bb82-b05f81eca4ed tempest-VolumesNegativeTest-2127792717 tempest-VolumesNegativeTest-2127792717-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:02:30.762168 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-f7bb057f-bd55-4132-bb82-b05f81eca4ed tempest-VolumesNegativeTest-2127792717 tempest-VolumesNegativeTest-2127792717-project] [instance: ee275bd4-5cd1-46e8-9084-74b027db92fa] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:02:30.768148 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-f7bb057f-bd55-4132-bb82-b05f81eca4ed tempest-VolumesNegativeTest-2127792717 tempest-VolumesNegativeTest-2127792717-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:30.768596 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-f7bb057f-bd55-4132-bb82-b05f81eca4ed tempest-VolumesNegativeTest-2127792717 tempest-VolumesNegativeTest-2127792717-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:30.769361 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-f7bb057f-bd55-4132-bb82-b05f81eca4ed tempest-VolumesNegativeTest-2127792717 tempest-VolumesNegativeTest-2127792717-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:30.769799 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-f7bb057f-bd55-4132-bb82-b05f81eca4ed tempest-VolumesNegativeTest-2127792717 tempest-VolumesNegativeTest-2127792717-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:30.783648 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.wsgi [None req-f7bb057f-bd55-4132-bb82-b05f81eca4ed tempest-VolumesNegativeTest-2127792717 tempest-VolumesNegativeTest-2127792717-project] HTTP exception thrown: Instance ee275bd4-5cd1-46e8-9084-74b027db92fa could not be found. Jun 16 23:02:30.785282 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-f7bb057f-bd55-4132-bb82-b05f81eca4ed tempest-VolumesNegativeTest-2127792717 tempest-VolumesNegativeTest-2127792717-project] Request method failure captured: Jun 16 23:02:30.785282 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: request: GET /compute/v2.1/servers/ee275bd4-5cd1-46e8-9084-74b027db92fa HTTP/1.1 Jun 16 23:02:30.785282 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Accept: application/json Jun 16 23:02:30.785282 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Accept-Encoding: identity Jun 16 23:02:30.785282 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Connection: close Jun 16 23:02:30.785282 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Content-Length: 0 Jun 16 23:02:30.785282 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Content-Type: application/json Jun 16 23:02:30.785282 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Host: 10.222.0.17 Jun 16 23:02:30.785282 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Openstack-System-Scope: None Jun 16 23:02:30.785282 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: User-Agent: python-urllib3/1.26.9 Jun 16 23:02:30.785282 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Auth-Token: gAAAAABiq7ZxUx_kd7yUfiwJ65xj4L5qGo09igl0fwO1sVwDLOe_VC1Zm23G5KJH8jDBCLWpiE_IfUaEmB0KtBlWmTaDNc7kBkKF5jVyiFwVEXwN-is6nA7npWgHDCfVZZ_BXhznNo6xnnqMSfAb7_e8eO2wmYqfObiaNGiM5E7uSzofMCXu7eE Jun 16 23:02:30.785282 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Domain-Id: None Jun 16 23:02:30.785282 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Domain-Name: None Jun 16 23:02:30.785282 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Identity-Status: Confirmed Jun 16 23:02:30.785282 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Is-Admin-Project: True Jun 16 23:02:30.785282 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Project-Domain-Id: default Jun 16 23:02:30.785282 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Project-Domain-Name: Default Jun 16 23:02:30.785282 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Project-Id: c90a3d32fe204da7a969528722141e75 Jun 16 23:02:30.785282 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Project-Name: tempest-VolumesNegativeTest-2127792717 Jun 16 23:02:30.785282 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Role: member,reader Jun 16 23:02:30.785282 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Roles: member,reader Jun 16 23:02:30.786698 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/c90a3d32fe204da7a969528722141e75"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_c90a3d32fe204da7a969528722141e75"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c90a3d32fe204da7a969528722141e75"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c90a3d32fe204da7a969528722141e75"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Jun 16 23:02:30.786698 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Tenant: tempest-VolumesNegativeTest-2127792717 Jun 16 23:02:30.786698 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Tenant-Id: c90a3d32fe204da7a969528722141e75 Jun 16 23:02:30.786698 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Tenant-Name: tempest-VolumesNegativeTest-2127792717 Jun 16 23:02:30.786698 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-User: tempest-VolumesNegativeTest-2127792717-project Jun 16 23:02:30.786698 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-User-Domain-Id: default Jun 16 23:02:30.786698 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-User-Domain-Name: Default Jun 16 23:02:30.786698 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-User-Id: 0ee1c54733f648ada66a143ce7516375 Jun 16 23:02:30.786698 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-User-Name: tempest-VolumesNegativeTest-2127792717-project Jun 16 23:02:30.786698 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: method: > Jun 16 23:02:30.786698 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: exception: Instance ee275bd4-5cd1-46e8-9084-74b027db92fa could not be found. Jun 16 23:02:30.786698 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: action_args: {'id': 'ee275bd4-5cd1-46e8-9084-74b027db92fa'} Jun 16 23:02:30.787552 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 23:02:30.787552 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 23:02:30.787552 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 23:02:30.787552 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 23:02:30.787552 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 23:02:30.787552 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 23:02:30.787552 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 23:02:30.787552 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 23:02:30.787552 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 23:02:30.787552 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 23:02:30.787552 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee275bd4-5cd1-46e8-9084-74b027db92fa could not be found. Jun 16 23:02:30.787552 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Jun 16 23:02:30.787552 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 23:02:30.787552 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Jun 16 23:02:30.787552 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 23:02:30.787552 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 23:02:30.787552 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 23:02:30.787552 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 23:02:30.787552 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 23:02:30.787552 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 23:02:30.788857 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 23:02:30.788857 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 23:02:30.788857 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 23:02:30.788857 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 23:02:30.788857 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 23:02:30.788857 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 23:02:30.788857 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 23:02:30.788857 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee275bd4-5cd1-46e8-9084-74b027db92fa could not be found. Jun 16 23:02:30.788857 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Jun 16 23:02:30.788857 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 23:02:30.788857 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Jun 16 23:02:30.788857 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 23:02:30.788857 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 23:02:30.788857 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 23:02:30.788857 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 23:02:30.788857 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 23:02:30.788857 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee275bd4-5cd1-46e8-9084-74b027db92fa could not be found. Jun 16 23:02:30.788857 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Jun 16 23:02:30.790023 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-f7bb057f-bd55-4132-bb82-b05f81eca4ed tempest-VolumesNegativeTest-2127792717 tempest-VolumesNegativeTest-2127792717-project] Returning 404 to user: Instance ee275bd4-5cd1-46e8-9084-74b027db92fa could not be found. {{(pid=117562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 23:02:30.790023 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-f7bb057f-bd55-4132-bb82-b05f81eca4ed tempest-VolumesNegativeTest-2127792717 tempest-VolumesNegativeTest-2127792717-project] 10.222.0.17 "GET /compute/v2.1/servers/ee275bd4-5cd1-46e8-9084-74b027db92fa" status: 404 len: 111 microversion: 2.1 time: 0.029424 Jun 16 23:02:30.790023 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 139/279] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:02:30 2022] GET /compute/v2.1/servers/ee275bd4-5cd1-46e8-9084-74b027db92fa => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 23:02:31.046647 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-00bd8b73-abe6-4da6-85b6-02eb469985dc tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Action: 'create', calling method: .version_select at 0x7f53201f5f70>, body: {"keypair": {"name": "tempest-keypair-1200536764", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP/BFJEQ7J1Xqd7XD1afbbIoCx+qqTd/Or34YQgD9ACKjr8mx9RgBbu83KCn+DmB+RmLIL8a9FlQSrlqE1ZbOeAgD/+xqmKX7fMOivMWiTS4wlhQXcuq7634UogMYQSDMQ=="}} {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 23:02:31.061843 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.quota [None req-00bd8b73-abe6-4da6-85b6-02eb469985dc tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Getting quotas for project 60447df5461141e883d207e028b74bc7. Resources: {'key_pairs'} {{(pid=117563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 23:02:31.065673 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.quota [None req-00bd8b73-abe6-4da6-85b6-02eb469985dc tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Getting quotas for user 243e592fbf1844d89f55dd5035a684f3 and project 60447df5461141e883d207e028b74bc7. Resources: {'key_pairs'} {{(pid=117563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 23:02:31.088379 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-00bd8b73-abe6-4da6-85b6-02eb469985dc tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.045827 Jun 16 23:02:31.088981 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 141/280] 10.222.0.17 () {60 vars in 1158 bytes} [Thu Jun 16 23:02:31 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 23:02:31.700766 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [req-a8279981-e2be-4ac4-b5d0-1fc381df66c1 req-7df2fc24-f843-4c65-87ca-76b0af4296ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa81794d-bc81-49d2-b4dc-6f57b43ecfe8", "tag": "218d229b-a7e5-4c33-9723-c6215e47e600"}]} {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 23:02:31.709086 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [req-a8279981-e2be-4ac4-b5d0-1fc381df66c1 req-7df2fc24-f843-4c65-87ca-76b0af4296ab service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:31.709530 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [req-a8279981-e2be-4ac4-b5d0-1fc381df66c1 req-7df2fc24-f843-4c65-87ca-76b0af4296ab service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:31.722412 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.compute.server_external_events [req-a8279981-e2be-4ac4-b5d0-1fc381df66c1 req-7df2fc24-f843-4c65-87ca-76b0af4296ab service nova] Creating event network-changed:218d229b-a7e5-4c33-9723-c6215e47e600 for instance aa81794d-bc81-49d2-b4dc-6f57b43ecfe8 on hv-cinder-84623 Jun 16 23:02:31.730576 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [req-a8279981-e2be-4ac4-b5d0-1fc381df66c1 req-7df2fc24-f843-4c65-87ca-76b0af4296ab service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033034 Jun 16 23:02:31.731796 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 140/281] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 23:02:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 23:02:31.734753 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-a4cff37e-22d2-41d7-b8fa-4bd4237a4e88 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:02:31.735300 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-a4cff37e-22d2-41d7-b8fa-4bd4237a4e88 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] [instance: aa81794d-bc81-49d2-b4dc-6f57b43ecfe8] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:02:31.761230 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-a4cff37e-22d2-41d7-b8fa-4bd4237a4e88 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:31.761671 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-a4cff37e-22d2-41d7-b8fa-4bd4237a4e88 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:31.762481 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-a4cff37e-22d2-41d7-b8fa-4bd4237a4e88 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:31.762936 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-a4cff37e-22d2-41d7-b8fa-4bd4237a4e88 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:31.939802 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-a4cff37e-22d2-41d7-b8fa-4bd4237a4e88 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01dd0e5661f44d05a01d7a5e82dbadf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b30b90ec4d5e45468a4fa0fb98e46393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:02:31.947812 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-a4cff37e-22d2-41d7-b8fa-4bd4237a4e88 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] 10.222.0.17 "GET /compute/v2.1/servers/aa81794d-bc81-49d2-b4dc-6f57b43ecfe8" status: 200 len: 1259 microversion: 2.1 time: 0.217874 Jun 16 23:02:31.948377 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 142/282] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:02:31 2022] GET /compute/v2.1/servers/aa81794d-bc81-49d2-b4dc-6f57b43ecfe8 => generated 1259 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 23:02:32.905876 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-9495e077-b08e-43a6-9de1-82c3148bd5c3 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-809290603", "imageRef": "2b486731-e5ea-4159-b6b1-ed0083e00543", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3b1257ed-1734-4595-b520-c36ad32e1031"}], "security_groups": [{"name": "tempest-securitygroup--378678144"}], "key_name": "tempest-keypair-1200536764", "user_data": "}} {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 23:02:32.969546 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-290a9598-0143-4f01-a202-538fb13213db tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:02:32.970921 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-290a9598-0143-4f01-a202-538fb13213db tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] [instance: aa81794d-bc81-49d2-b4dc-6f57b43ecfe8] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:02:32.980327 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-290a9598-0143-4f01-a202-538fb13213db tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:32.981541 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-290a9598-0143-4f01-a202-538fb13213db tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:32.983024 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-290a9598-0143-4f01-a202-538fb13213db tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:32.984517 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-290a9598-0143-4f01-a202-538fb13213db tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:33.071098 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.network.neutron [None req-9495e077-b08e-43a6-9de1-82c3148bd5c3 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] validate_networks() for [('3b1257ed-1734-4595-b520-c36ad32e1031', None, None, None, None, None)] {{(pid=117562) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 23:02:33.221681 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-290a9598-0143-4f01-a202-538fb13213db tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01dd0e5661f44d05a01d7a5e82dbadf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b30b90ec4d5e45468a4fa0fb98e46393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:02:33.233057 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-290a9598-0143-4f01-a202-538fb13213db tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] 10.222.0.17 "GET /compute/v2.1/servers/aa81794d-bc81-49d2-b4dc-6f57b43ecfe8" status: 200 len: 1259 microversion: 2.1 time: 0.271494 Jun 16 23:02:33.238316 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 143/283] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:02:32 2022] GET /compute/v2.1/servers/aa81794d-bc81-49d2-b4dc-6f57b43ecfe8 => generated 1259 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:02:33.272692 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG dbcounter [-] [117562] Writing DB stats nova_cell0:SELECT=2 {{(pid=117562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 23:02:33.301140 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG dbcounter [-] [117562] Writing DB stats nova_cell0:SELECT=6 {{(pid=117562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 23:02:33.579804 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.virt.hardware [None req-9495e077-b08e-43a6-9de1-82c3148bd5c3 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Flavor limits 0:0:0 {{(pid=117562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 23:02:33.580389 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.virt.hardware [None req-9495e077-b08e-43a6-9de1-82c3148bd5c3 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Image limits 0:0:0 {{(pid=117562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 23:02:33.581306 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.virt.hardware [None req-9495e077-b08e-43a6-9de1-82c3148bd5c3 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Flavor pref 0:0:0 {{(pid=117562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 23:02:33.581723 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.virt.hardware [None req-9495e077-b08e-43a6-9de1-82c3148bd5c3 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Image pref 0:0:0 {{(pid=117562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 23:02:33.582711 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.virt.hardware [None req-9495e077-b08e-43a6-9de1-82c3148bd5c3 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 23:02:33.594081 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-9495e077-b08e-43a6-9de1-82c3148bd5c3 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:33.594924 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-9495e077-b08e-43a6-9de1-82c3148bd5c3 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:33.596148 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-9495e077-b08e-43a6-9de1-82c3148bd5c3 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:33.597062 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-9495e077-b08e-43a6-9de1-82c3148bd5c3 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:33.617219 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.quota [None req-9495e077-b08e-43a6-9de1-82c3148bd5c3 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Getting quotas for project 60447df5461141e883d207e028b74bc7. Resources: {'instances', 'cores', 'ram'} {{(pid=117562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 23:02:33.621495 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.quota [None req-9495e077-b08e-43a6-9de1-82c3148bd5c3 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Getting quotas for user 243e592fbf1844d89f55dd5035a684f3 and project 60447df5461141e883d207e028b74bc7. Resources: {'instances', 'cores', 'ram'} {{(pid=117562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 23:02:33.633164 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-9495e077-b08e-43a6-9de1-82c3148bd5c3 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Going to run 1 instances... {{(pid=117562) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 23:02:33.636558 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-9495e077-b08e-43a6-9de1-82c3148bd5c3 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] [instance: 8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2b486731-e5ea-4159-b6b1-ed0083e00543',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 23:02:33.688247 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-9495e077-b08e-43a6-9de1-82c3148bd5c3 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.787105 Jun 16 23:02:33.689187 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 141/284] 10.222.0.17 () {60 vars in 1146 bytes} [Thu Jun 16 23:02:32 2022] POST /compute/v2.1/servers => generated 408 bytes in 789 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 23:02:33.700488 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-e795a9be-cee0-41df-8b4a-eb5093271822 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:02:33.701677 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-e795a9be-cee0-41df-8b4a-eb5093271822 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] [instance: 8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:02:33.770262 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-e795a9be-cee0-41df-8b4a-eb5093271822 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '243e592fbf1844d89f55dd5035a684f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60447df5461141e883d207e028b74bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:02:33.777286 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-e795a9be-cee0-41df-8b4a-eb5093271822 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] 10.222.0.17 "GET /compute/v2.1/servers/8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8" status: 200 len: 1245 microversion: 2.1 time: 0.081094 Jun 16 23:02:33.777853 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 144/285] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:02:33 2022] GET /compute/v2.1/servers/8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8 => generated 1245 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:02:34.255118 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-2d723f47-51ea-453e-af14-7c5c91da5089 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:02:34.255502 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-2d723f47-51ea-453e-af14-7c5c91da5089 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] [instance: aa81794d-bc81-49d2-b4dc-6f57b43ecfe8] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:02:34.263244 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-2d723f47-51ea-453e-af14-7c5c91da5089 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:34.263829 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-2d723f47-51ea-453e-af14-7c5c91da5089 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:34.265023 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-2d723f47-51ea-453e-af14-7c5c91da5089 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:34.265853 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-2d723f47-51ea-453e-af14-7c5c91da5089 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:34.416807 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-2d723f47-51ea-453e-af14-7c5c91da5089 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01dd0e5661f44d05a01d7a5e82dbadf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b30b90ec4d5e45468a4fa0fb98e46393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:02:34.426101 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-2d723f47-51ea-453e-af14-7c5c91da5089 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] 10.222.0.17 "GET /compute/v2.1/servers/aa81794d-bc81-49d2-b4dc-6f57b43ecfe8" status: 200 len: 1259 microversion: 2.1 time: 0.176948 Jun 16 23:02:34.426672 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 142/286] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:02:34 2022] GET /compute/v2.1/servers/aa81794d-bc81-49d2-b4dc-6f57b43ecfe8 => generated 1259 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:02:34.796922 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-9e2ab2ec-72c8-4432-a131-a7917bbe842b tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:02:34.797631 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-9e2ab2ec-72c8-4432-a131-a7917bbe842b tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] [instance: 8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:02:34.805057 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-9e2ab2ec-72c8-4432-a131-a7917bbe842b tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:34.806483 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-9e2ab2ec-72c8-4432-a131-a7917bbe842b tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:34.807714 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-9e2ab2ec-72c8-4432-a131-a7917bbe842b tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:34.808217 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-9e2ab2ec-72c8-4432-a131-a7917bbe842b tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:34.920768 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-9e2ab2ec-72c8-4432-a131-a7917bbe842b tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '243e592fbf1844d89f55dd5035a684f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60447df5461141e883d207e028b74bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:02:34.931761 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-9e2ab2ec-72c8-4432-a131-a7917bbe842b tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] 10.222.0.17 "GET /compute/v2.1/servers/8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8" status: 200 len: 1297 microversion: 2.1 time: 0.139896 Jun 16 23:02:34.935288 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 145/287] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:02:34 2022] GET /compute/v2.1/servers/8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8 => generated 1297 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:02:35.443781 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-fff6e1e7-3bb6-4ae7-ab23-7d3ef4c7df77 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:02:35.445220 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-fff6e1e7-3bb6-4ae7-ab23-7d3ef4c7df77 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] [instance: aa81794d-bc81-49d2-b4dc-6f57b43ecfe8] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:02:35.452200 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-fff6e1e7-3bb6-4ae7-ab23-7d3ef4c7df77 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:35.452652 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-fff6e1e7-3bb6-4ae7-ab23-7d3ef4c7df77 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:35.453573 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-fff6e1e7-3bb6-4ae7-ab23-7d3ef4c7df77 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:35.454014 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-fff6e1e7-3bb6-4ae7-ab23-7d3ef4c7df77 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:35.659002 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-fff6e1e7-3bb6-4ae7-ab23-7d3ef4c7df77 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01dd0e5661f44d05a01d7a5e82dbadf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b30b90ec4d5e45468a4fa0fb98e46393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:02:35.673058 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-fff6e1e7-3bb6-4ae7-ab23-7d3ef4c7df77 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] 10.222.0.17 "GET /compute/v2.1/servers/aa81794d-bc81-49d2-b4dc-6f57b43ecfe8" status: 200 len: 1259 microversion: 2.1 time: 0.233834 Jun 16 23:02:35.673855 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 143/288] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:02:35 2022] GET /compute/v2.1/servers/aa81794d-bc81-49d2-b4dc-6f57b43ecfe8 => generated 1259 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 23:02:35.950066 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-5df68649-6c1b-4956-a1ad-3c71c3796665 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:02:35.951112 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-5df68649-6c1b-4956-a1ad-3c71c3796665 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] [instance: 8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:02:35.960663 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-5df68649-6c1b-4956-a1ad-3c71c3796665 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:35.961121 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-5df68649-6c1b-4956-a1ad-3c71c3796665 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:35.961938 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-5df68649-6c1b-4956-a1ad-3c71c3796665 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:35.962494 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-5df68649-6c1b-4956-a1ad-3c71c3796665 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:36.136489 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-5df68649-6c1b-4956-a1ad-3c71c3796665 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '243e592fbf1844d89f55dd5035a684f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60447df5461141e883d207e028b74bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:02:36.145658 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-5df68649-6c1b-4956-a1ad-3c71c3796665 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] 10.222.0.17 "GET /compute/v2.1/servers/8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8" status: 200 len: 1370 microversion: 2.1 time: 0.200657 Jun 16 23:02:36.146185 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 146/289] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:02:35 2022] GET /compute/v2.1/servers/8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8 => generated 1370 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:02:36.690383 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-3205c60b-a77a-4744-bc5c-e8f3699e648a tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:02:36.691180 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-3205c60b-a77a-4744-bc5c-e8f3699e648a tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] [instance: aa81794d-bc81-49d2-b4dc-6f57b43ecfe8] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:02:36.699123 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-3205c60b-a77a-4744-bc5c-e8f3699e648a tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:36.699580 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-3205c60b-a77a-4744-bc5c-e8f3699e648a tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:36.700368 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-3205c60b-a77a-4744-bc5c-e8f3699e648a tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:36.700805 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-3205c60b-a77a-4744-bc5c-e8f3699e648a tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:36.991622 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-3205c60b-a77a-4744-bc5c-e8f3699e648a tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01dd0e5661f44d05a01d7a5e82dbadf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b30b90ec4d5e45468a4fa0fb98e46393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:02:37.005271 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-3205c60b-a77a-4744-bc5c-e8f3699e648a tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] 10.222.0.17 "GET /compute/v2.1/servers/aa81794d-bc81-49d2-b4dc-6f57b43ecfe8" status: 200 len: 1259 microversion: 2.1 time: 0.315177 Jun 16 23:02:37.015246 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 144/290] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:02:36 2022] GET /compute/v2.1/servers/aa81794d-bc81-49d2-b4dc-6f57b43ecfe8 => generated 1259 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:02:37.167799 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-5c0cbc16-2bb5-4aa9-acbf-231cacaf1e9c tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:02:37.171310 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-5c0cbc16-2bb5-4aa9-acbf-231cacaf1e9c tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] [instance: 8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:02:37.201094 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-5c0cbc16-2bb5-4aa9-acbf-231cacaf1e9c tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:37.202297 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-5c0cbc16-2bb5-4aa9-acbf-231cacaf1e9c tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:37.209686 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-5c0cbc16-2bb5-4aa9-acbf-231cacaf1e9c tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:37.211741 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-5c0cbc16-2bb5-4aa9-acbf-231cacaf1e9c tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:37.461301 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-5c0cbc16-2bb5-4aa9-acbf-231cacaf1e9c tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '243e592fbf1844d89f55dd5035a684f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60447df5461141e883d207e028b74bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:02:37.471651 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-5c0cbc16-2bb5-4aa9-acbf-231cacaf1e9c tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] 10.222.0.17 "GET /compute/v2.1/servers/8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8" status: 200 len: 1370 microversion: 2.1 time: 0.312624 Jun 16 23:02:37.472359 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 147/291] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:02:37 2022] GET /compute/v2.1/servers/8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8 => generated 1370 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:02:37.702897 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-cf00dbbe-2b26-490b-87ae-5c18a366f2e2 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:02:37.703972 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-cf00dbbe-2b26-490b-87ae-5c18a366f2e2 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] [instance: f4c73822-1dfa-4eed-bf02-1123b0402755] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:02:37.710140 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-cf00dbbe-2b26-490b-87ae-5c18a366f2e2 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:37.710616 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-cf00dbbe-2b26-490b-87ae-5c18a366f2e2 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:37.711623 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-cf00dbbe-2b26-490b-87ae-5c18a366f2e2 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:37.712224 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-cf00dbbe-2b26-490b-87ae-5c18a366f2e2 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:37.738641 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-cf00dbbe-2b26-490b-87ae-5c18a366f2e2 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] 10.222.0.17 "GET /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755/ips" status: 200 len: 145 microversion: 2.1 time: 0.039531 Jun 16 23:02:37.739316 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 145/292] 10.222.0.17 () {58 vars in 1247 bytes} [Thu Jun 16 23:02:37 2022] GET /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755/ips => generated 145 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 23:02:37.819081 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [req-5319de4b-0d23-4028-b288-5a593db3d62d req-aafb9dba-56eb-48ca-927b-7662ae7bc5ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8", "tag": "823b7d46-8462-4945-943b-09a9fc1c8dce"}]} {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 23:02:37.828048 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-5319de4b-0d23-4028-b288-5a593db3d62d req-aafb9dba-56eb-48ca-927b-7662ae7bc5ba service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:37.828863 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-5319de4b-0d23-4028-b288-5a593db3d62d req-aafb9dba-56eb-48ca-927b-7662ae7bc5ba service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:37.841381 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.compute.server_external_events [req-5319de4b-0d23-4028-b288-5a593db3d62d req-aafb9dba-56eb-48ca-927b-7662ae7bc5ba service nova] Creating event network-changed:823b7d46-8462-4945-943b-09a9fc1c8dce for instance 8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8 on hv-cinder-84623 Jun 16 23:02:37.852951 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [req-5319de4b-0d23-4028-b288-5a593db3d62d req-aafb9dba-56eb-48ca-927b-7662ae7bc5ba service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036904 Jun 16 23:02:37.853985 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 148/293] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 23:02:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 23:02:38.023641 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-dc869ddb-5e63-4105-8221-b3ae6709edaa tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:02:38.025176 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-dc869ddb-5e63-4105-8221-b3ae6709edaa tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] [instance: aa81794d-bc81-49d2-b4dc-6f57b43ecfe8] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:02:38.033175 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-dc869ddb-5e63-4105-8221-b3ae6709edaa tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:38.033839 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-dc869ddb-5e63-4105-8221-b3ae6709edaa tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:38.035390 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-dc869ddb-5e63-4105-8221-b3ae6709edaa tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:38.035838 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-dc869ddb-5e63-4105-8221-b3ae6709edaa tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:38.183977 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-dc869ddb-5e63-4105-8221-b3ae6709edaa tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01dd0e5661f44d05a01d7a5e82dbadf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b30b90ec4d5e45468a4fa0fb98e46393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:02:38.192312 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-dc869ddb-5e63-4105-8221-b3ae6709edaa tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] 10.222.0.17 "GET /compute/v2.1/servers/aa81794d-bc81-49d2-b4dc-6f57b43ecfe8" status: 200 len: 1259 microversion: 2.1 time: 0.173718 Jun 16 23:02:38.192886 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 146/294] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:02:38 2022] GET /compute/v2.1/servers/aa81794d-bc81-49d2-b4dc-6f57b43ecfe8 => generated 1259 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:02:38.491737 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-da84e160-a1d8-4a60-b914-447db11d934a tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:02:38.492570 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-da84e160-a1d8-4a60-b914-447db11d934a tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] [instance: 8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:02:38.499210 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-da84e160-a1d8-4a60-b914-447db11d934a tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:38.499660 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-da84e160-a1d8-4a60-b914-447db11d934a tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:38.500565 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-da84e160-a1d8-4a60-b914-447db11d934a tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:38.500995 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-da84e160-a1d8-4a60-b914-447db11d934a tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:38.674361 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-da84e160-a1d8-4a60-b914-447db11d934a tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '243e592fbf1844d89f55dd5035a684f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60447df5461141e883d207e028b74bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:02:38.684718 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-da84e160-a1d8-4a60-b914-447db11d934a tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] 10.222.0.17 "GET /compute/v2.1/servers/8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8" status: 200 len: 1370 microversion: 2.1 time: 0.196899 Jun 16 23:02:38.685514 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 149/295] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:02:38 2022] GET /compute/v2.1/servers/8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8 => generated 1370 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:02:38.779480 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [req-81c380ae-6424-4065-aceb-9a91dd0ce169 req-942ae86a-6305-49f0-8c5b-4e3ccea0f4d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa81794d-bc81-49d2-b4dc-6f57b43ecfe8", "name": "network-vif-plugged", "status": "completed", "tag": "218d229b-a7e5-4c33-9723-c6215e47e600"}]} {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 23:02:38.796959 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [req-81c380ae-6424-4065-aceb-9a91dd0ce169 req-942ae86a-6305-49f0-8c5b-4e3ccea0f4d5 service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:38.797406 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [req-81c380ae-6424-4065-aceb-9a91dd0ce169 req-942ae86a-6305-49f0-8c5b-4e3ccea0f4d5 service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:38.816511 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.compute.server_external_events [req-81c380ae-6424-4065-aceb-9a91dd0ce169 req-942ae86a-6305-49f0-8c5b-4e3ccea0f4d5 service nova] Creating event network-vif-plugged:218d229b-a7e5-4c33-9723-c6215e47e600 for instance aa81794d-bc81-49d2-b4dc-6f57b43ecfe8 on hv-cinder-84623 Jun 16 23:02:38.823713 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [req-81c380ae-6424-4065-aceb-9a91dd0ce169 req-942ae86a-6305-49f0-8c5b-4e3ccea0f4d5 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047419 Jun 16 23:02:38.824313 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 147/296] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 23:02:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 23:02:39.210503 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-3026d526-995e-4ef3-be03-b91b2bb12e65 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:02:39.210638 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-3026d526-995e-4ef3-be03-b91b2bb12e65 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] [instance: aa81794d-bc81-49d2-b4dc-6f57b43ecfe8] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:02:39.218335 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-3026d526-995e-4ef3-be03-b91b2bb12e65 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:39.218921 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-3026d526-995e-4ef3-be03-b91b2bb12e65 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:39.219907 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-3026d526-995e-4ef3-be03-b91b2bb12e65 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:39.220524 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-3026d526-995e-4ef3-be03-b91b2bb12e65 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:39.365427 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-3026d526-995e-4ef3-be03-b91b2bb12e65 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01dd0e5661f44d05a01d7a5e82dbadf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b30b90ec4d5e45468a4fa0fb98e46393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:02:39.374660 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-3026d526-995e-4ef3-be03-b91b2bb12e65 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] 10.222.0.17 "GET /compute/v2.1/servers/aa81794d-bc81-49d2-b4dc-6f57b43ecfe8" status: 200 len: 1259 microversion: 2.1 time: 0.169178 Jun 16 23:02:39.375665 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 150/297] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:02:39 2022] GET /compute/v2.1/servers/aa81794d-bc81-49d2-b4dc-6f57b43ecfe8 => generated 1259 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:02:39.702502 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-3811831b-3c05-485c-8952-9bf871822b96 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:02:39.703510 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-3811831b-3c05-485c-8952-9bf871822b96 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] [instance: 8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:02:39.712213 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-3811831b-3c05-485c-8952-9bf871822b96 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:39.712951 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-3811831b-3c05-485c-8952-9bf871822b96 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:39.713909 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-3811831b-3c05-485c-8952-9bf871822b96 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:39.714506 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-3811831b-3c05-485c-8952-9bf871822b96 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:39.867544 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-3811831b-3c05-485c-8952-9bf871822b96 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '243e592fbf1844d89f55dd5035a684f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60447df5461141e883d207e028b74bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:02:39.876925 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-3811831b-3c05-485c-8952-9bf871822b96 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] 10.222.0.17 "GET /compute/v2.1/servers/8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8" status: 200 len: 1370 microversion: 2.1 time: 0.178584 Jun 16 23:02:39.885990 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 148/298] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:02:39 2022] GET /compute/v2.1/servers/8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8 => generated 1370 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:02:40.391792 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-4f173988-a01a-4325-be36-878a12418833 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:02:40.392428 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-4f173988-a01a-4325-be36-878a12418833 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] [instance: aa81794d-bc81-49d2-b4dc-6f57b43ecfe8] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:02:40.400030 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-4f173988-a01a-4325-be36-878a12418833 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:40.400477 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-4f173988-a01a-4325-be36-878a12418833 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:40.401243 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-4f173988-a01a-4325-be36-878a12418833 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:40.401672 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-4f173988-a01a-4325-be36-878a12418833 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:40.538138 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-4f173988-a01a-4325-be36-878a12418833 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01dd0e5661f44d05a01d7a5e82dbadf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b30b90ec4d5e45468a4fa0fb98e46393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:02:40.545564 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-4f173988-a01a-4325-be36-878a12418833 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] 10.222.0.17 "GET /compute/v2.1/servers/aa81794d-bc81-49d2-b4dc-6f57b43ecfe8" status: 200 len: 1259 microversion: 2.1 time: 0.157650 Jun 16 23:02:40.546209 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 151/299] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:02:40 2022] GET /compute/v2.1/servers/aa81794d-bc81-49d2-b4dc-6f57b43ecfe8 => generated 1259 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:02:40.893023 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-93d6e950-e5ec-419a-bcec-e2d068e538c0 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:02:40.893631 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-93d6e950-e5ec-419a-bcec-e2d068e538c0 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] [instance: 8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:02:40.899862 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-93d6e950-e5ec-419a-bcec-e2d068e538c0 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:40.900273 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-93d6e950-e5ec-419a-bcec-e2d068e538c0 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:40.901103 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-93d6e950-e5ec-419a-bcec-e2d068e538c0 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:40.901644 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-93d6e950-e5ec-419a-bcec-e2d068e538c0 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:40.916419 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG dbcounter [-] [117562] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 23:02:41.037106 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-93d6e950-e5ec-419a-bcec-e2d068e538c0 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '243e592fbf1844d89f55dd5035a684f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60447df5461141e883d207e028b74bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:02:41.044646 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-93d6e950-e5ec-419a-bcec-e2d068e538c0 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] 10.222.0.17 "GET /compute/v2.1/servers/8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8" status: 200 len: 1370 microversion: 2.1 time: 0.155410 Jun 16 23:02:41.045214 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 149/300] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:02:40 2022] GET /compute/v2.1/servers/8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8 => generated 1370 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:02:41.562209 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-d0eb210c-45a0-4df4-9da9-f7346800176f tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:02:41.562965 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-d0eb210c-45a0-4df4-9da9-f7346800176f tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] [instance: aa81794d-bc81-49d2-b4dc-6f57b43ecfe8] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:02:41.569374 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-d0eb210c-45a0-4df4-9da9-f7346800176f tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:41.569823 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-d0eb210c-45a0-4df4-9da9-f7346800176f tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:41.571174 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-d0eb210c-45a0-4df4-9da9-f7346800176f tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:41.571618 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-d0eb210c-45a0-4df4-9da9-f7346800176f tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:41.701929 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-d0eb210c-45a0-4df4-9da9-f7346800176f tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01dd0e5661f44d05a01d7a5e82dbadf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b30b90ec4d5e45468a4fa0fb98e46393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:02:41.710740 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-d0eb210c-45a0-4df4-9da9-f7346800176f tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] 10.222.0.17 "GET /compute/v2.1/servers/aa81794d-bc81-49d2-b4dc-6f57b43ecfe8" status: 200 len: 1259 microversion: 2.1 time: 0.151591 Jun 16 23:02:41.711471 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 152/301] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:02:41 2022] GET /compute/v2.1/servers/aa81794d-bc81-49d2-b4dc-6f57b43ecfe8 => generated 1259 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:02:42.063018 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-b0ae02cb-50d4-4d55-af04-e19dfd2ef043 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:02:42.064153 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-b0ae02cb-50d4-4d55-af04-e19dfd2ef043 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] [instance: 8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:02:42.072380 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-b0ae02cb-50d4-4d55-af04-e19dfd2ef043 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:42.072836 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-b0ae02cb-50d4-4d55-af04-e19dfd2ef043 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:42.073615 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-b0ae02cb-50d4-4d55-af04-e19dfd2ef043 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:42.074050 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-b0ae02cb-50d4-4d55-af04-e19dfd2ef043 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:42.229489 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-b0ae02cb-50d4-4d55-af04-e19dfd2ef043 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '243e592fbf1844d89f55dd5035a684f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60447df5461141e883d207e028b74bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:02:42.241191 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-b0ae02cb-50d4-4d55-af04-e19dfd2ef043 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] 10.222.0.17 "GET /compute/v2.1/servers/8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8" status: 200 len: 1370 microversion: 2.1 time: 0.182598 Jun 16 23:02:42.241743 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 150/302] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:02:42 2022] GET /compute/v2.1/servers/8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8 => generated 1370 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:02:42.731737 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-a573d7e4-6a83-43ab-9271-b1679472263b tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:02:42.733343 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-a573d7e4-6a83-43ab-9271-b1679472263b tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] [instance: aa81794d-bc81-49d2-b4dc-6f57b43ecfe8] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:02:42.742214 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG dbcounter [-] [117563] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=1 {{(pid=117563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 23:02:42.744802 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-a573d7e4-6a83-43ab-9271-b1679472263b tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:42.745330 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-a573d7e4-6a83-43ab-9271-b1679472263b tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:42.746206 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-a573d7e4-6a83-43ab-9271-b1679472263b tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:42.746748 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-a573d7e4-6a83-43ab-9271-b1679472263b tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:42.859058 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-e0e89fcf-53c6-4b2a-99f9-b2e2d9c95bba tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6f4c4fe3-f8fc-4888-9328-840899d54d05"}} {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 23:02:42.860245 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-e0e89fcf-53c6-4b2a-99f9-b2e2d9c95bba tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] [instance: f4c73822-1dfa-4eed-bf02-1123b0402755] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:02:42.866277 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-e0e89fcf-53c6-4b2a-99f9-b2e2d9c95bba tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:42.866759 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-e0e89fcf-53c6-4b2a-99f9-b2e2d9c95bba tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:42.867568 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-e0e89fcf-53c6-4b2a-99f9-b2e2d9c95bba tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:42.868001 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-e0e89fcf-53c6-4b2a-99f9-b2e2d9c95bba tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:42.886952 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-a573d7e4-6a83-43ab-9271-b1679472263b tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01dd0e5661f44d05a01d7a5e82dbadf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b30b90ec4d5e45468a4fa0fb98e46393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:02:42.894799 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-a573d7e4-6a83-43ab-9271-b1679472263b tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] 10.222.0.17 "GET /compute/v2.1/servers/aa81794d-bc81-49d2-b4dc-6f57b43ecfe8" status: 200 len: 1259 microversion: 2.1 time: 0.169872 Jun 16 23:02:42.895372 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 153/303] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:02:42 2022] GET /compute/v2.1/servers/aa81794d-bc81-49d2-b4dc-6f57b43ecfe8 => generated 1259 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:02:43.249364 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-e0e89fcf-53c6-4b2a-99f9-b2e2d9c95bba tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] 10.222.0.17 "POST /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.394093 Jun 16 23:02:43.249924 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 151/304] 10.222.0.17 () {60 vars in 1322 bytes} [Thu Jun 16 23:02:42 2022] POST /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755/os-volume_attachments => generated 194 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 23:02:43.258947 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-e64098ca-1682-40a2-9d88-a9270d58b690 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:02:43.259826 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-e64098ca-1682-40a2-9d88-a9270d58b690 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] [instance: 8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:02:43.268949 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-e64098ca-1682-40a2-9d88-a9270d58b690 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:43.269529 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-e64098ca-1682-40a2-9d88-a9270d58b690 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:43.270894 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-e64098ca-1682-40a2-9d88-a9270d58b690 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:43.272170 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-e64098ca-1682-40a2-9d88-a9270d58b690 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:43.408799 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-e64098ca-1682-40a2-9d88-a9270d58b690 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '243e592fbf1844d89f55dd5035a684f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60447df5461141e883d207e028b74bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:02:43.412353 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG dbcounter [-] [117563] Writing DB stats nova_cell1:SELECT=100 {{(pid=117563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 23:02:43.417580 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-e64098ca-1682-40a2-9d88-a9270d58b690 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] 10.222.0.17 "GET /compute/v2.1/servers/8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8" status: 200 len: 1370 microversion: 2.1 time: 0.163022 Jun 16 23:02:43.418219 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 154/305] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:02:43 2022] GET /compute/v2.1/servers/8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8 => generated 1370 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:02:43.908995 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG dbcounter [-] [117562] Writing DB stats nova_cell0:SELECT=2 {{(pid=117562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 23:02:43.909737 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG dbcounter [-] [117562] Writing DB stats nova_cell0:SELECT=6 {{(pid=117562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 23:02:43.913804 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-17430d90-0cf6-4456-b4ef-0c9de6ad3b5d tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:02:43.914526 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-17430d90-0cf6-4456-b4ef-0c9de6ad3b5d tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] [instance: aa81794d-bc81-49d2-b4dc-6f57b43ecfe8] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:02:43.921667 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-17430d90-0cf6-4456-b4ef-0c9de6ad3b5d tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:43.922397 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-17430d90-0cf6-4456-b4ef-0c9de6ad3b5d tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:43.923195 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-17430d90-0cf6-4456-b4ef-0c9de6ad3b5d tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:43.923633 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-17430d90-0cf6-4456-b4ef-0c9de6ad3b5d tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:44.061992 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-17430d90-0cf6-4456-b4ef-0c9de6ad3b5d tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01dd0e5661f44d05a01d7a5e82dbadf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b30b90ec4d5e45468a4fa0fb98e46393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:02:44.070112 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-17430d90-0cf6-4456-b4ef-0c9de6ad3b5d tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] 10.222.0.17 "GET /compute/v2.1/servers/aa81794d-bc81-49d2-b4dc-6f57b43ecfe8" status: 200 len: 1259 microversion: 2.1 time: 0.162349 Jun 16 23:02:44.070783 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 152/306] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:02:43 2022] GET /compute/v2.1/servers/aa81794d-bc81-49d2-b4dc-6f57b43ecfe8 => generated 1259 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:02:44.434791 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-64d3e684-0138-4c0c-8220-425131a12a1c tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:02:44.435386 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-64d3e684-0138-4c0c-8220-425131a12a1c tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] [instance: 8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:02:44.437564 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG dbcounter [-] [117563] Writing DB stats nova_cell0:SELECT=8 {{(pid=117563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 23:02:44.443301 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-64d3e684-0138-4c0c-8220-425131a12a1c tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:44.443745 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-64d3e684-0138-4c0c-8220-425131a12a1c tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:44.444504 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-64d3e684-0138-4c0c-8220-425131a12a1c tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:44.444936 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-64d3e684-0138-4c0c-8220-425131a12a1c tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:44.571007 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-64d3e684-0138-4c0c-8220-425131a12a1c tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '243e592fbf1844d89f55dd5035a684f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60447df5461141e883d207e028b74bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:02:44.578799 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-64d3e684-0138-4c0c-8220-425131a12a1c tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] 10.222.0.17 "GET /compute/v2.1/servers/8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8" status: 200 len: 1370 microversion: 2.1 time: 0.147947 Jun 16 23:02:44.579352 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 155/307] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:02:44 2022] GET /compute/v2.1/servers/8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8 => generated 1370 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:02:45.086232 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-863ff78f-e656-4248-9b54-afb3ae547687 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:02:45.086871 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-863ff78f-e656-4248-9b54-afb3ae547687 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] [instance: aa81794d-bc81-49d2-b4dc-6f57b43ecfe8] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:02:45.093328 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-863ff78f-e656-4248-9b54-afb3ae547687 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:45.093778 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-863ff78f-e656-4248-9b54-afb3ae547687 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:45.094540 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-863ff78f-e656-4248-9b54-afb3ae547687 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:45.095003 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-863ff78f-e656-4248-9b54-afb3ae547687 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:45.226114 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-863ff78f-e656-4248-9b54-afb3ae547687 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01dd0e5661f44d05a01d7a5e82dbadf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b30b90ec4d5e45468a4fa0fb98e46393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:02:45.233561 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-863ff78f-e656-4248-9b54-afb3ae547687 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] 10.222.0.17 "GET /compute/v2.1/servers/aa81794d-bc81-49d2-b4dc-6f57b43ecfe8" status: 200 len: 1259 microversion: 2.1 time: 0.151020 Jun 16 23:02:45.234116 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 153/308] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:02:45 2022] GET /compute/v2.1/servers/aa81794d-bc81-49d2-b4dc-6f57b43ecfe8 => generated 1259 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:02:45.595545 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-b31502e8-311b-4ef3-8981-b3b24bd70495 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:02:45.596185 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-b31502e8-311b-4ef3-8981-b3b24bd70495 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] [instance: 8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:02:45.602963 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-b31502e8-311b-4ef3-8981-b3b24bd70495 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:45.603419 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-b31502e8-311b-4ef3-8981-b3b24bd70495 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:45.604215 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-b31502e8-311b-4ef3-8981-b3b24bd70495 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:45.604656 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-b31502e8-311b-4ef3-8981-b3b24bd70495 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:45.729949 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-b31502e8-311b-4ef3-8981-b3b24bd70495 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '243e592fbf1844d89f55dd5035a684f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60447df5461141e883d207e028b74bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:02:45.737334 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-b31502e8-311b-4ef3-8981-b3b24bd70495 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] 10.222.0.17 "GET /compute/v2.1/servers/8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8" status: 200 len: 1370 microversion: 2.1 time: 0.145719 Jun 16 23:02:45.737893 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 156/309] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:02:45 2022] GET /compute/v2.1/servers/8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8 => generated 1370 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:02:46.250662 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-d4f3e99d-d9ab-4b99-a57c-2c115aa798bd tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:02:46.251359 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-d4f3e99d-d9ab-4b99-a57c-2c115aa798bd tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] [instance: aa81794d-bc81-49d2-b4dc-6f57b43ecfe8] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:02:46.261412 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-d4f3e99d-d9ab-4b99-a57c-2c115aa798bd tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:46.262070 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-d4f3e99d-d9ab-4b99-a57c-2c115aa798bd tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:46.264842 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-d4f3e99d-d9ab-4b99-a57c-2c115aa798bd tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:46.264842 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-d4f3e99d-d9ab-4b99-a57c-2c115aa798bd tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:46.408754 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-d4f3e99d-d9ab-4b99-a57c-2c115aa798bd tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01dd0e5661f44d05a01d7a5e82dbadf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b30b90ec4d5e45468a4fa0fb98e46393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:02:46.416796 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-d4f3e99d-d9ab-4b99-a57c-2c115aa798bd tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] 10.222.0.17 "GET /compute/v2.1/servers/aa81794d-bc81-49d2-b4dc-6f57b43ecfe8" status: 200 len: 1259 microversion: 2.1 time: 0.171359 Jun 16 23:02:46.417256 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 154/310] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:02:46 2022] GET /compute/v2.1/servers/aa81794d-bc81-49d2-b4dc-6f57b43ecfe8 => generated 1259 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:02:46.574077 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-7ad722aa-460a-49d0-bf79-28fb75738519 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:02:46.574491 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-7ad722aa-460a-49d0-bf79-28fb75738519 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 46f43909-d681-4938-8253-5080b626e169] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:02:46.580664 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-7ad722aa-460a-49d0-bf79-28fb75738519 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:46.581106 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-7ad722aa-460a-49d0-bf79-28fb75738519 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:46.581891 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-7ad722aa-460a-49d0-bf79-28fb75738519 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:46.582325 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-7ad722aa-460a-49d0-bf79-28fb75738519 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:46.605968 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-7ad722aa-460a-49d0-bf79-28fb75738519 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169/ips" status: 200 len: 152 microversion: 2.20 time: 0.036465 Jun 16 23:02:46.606639 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 157/311] 10.222.0.17 () {60 vars in 1288 bytes} [Thu Jun 16 23:02:46 2022] GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169/ips => generated 152 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 23:02:46.764492 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-59e9fa30-6c4e-4058-b430-ef8bd06451b4 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:02:46.765186 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-59e9fa30-6c4e-4058-b430-ef8bd06451b4 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] [instance: 8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:02:46.780862 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-59e9fa30-6c4e-4058-b430-ef8bd06451b4 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:46.781538 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-59e9fa30-6c4e-4058-b430-ef8bd06451b4 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:46.783543 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-59e9fa30-6c4e-4058-b430-ef8bd06451b4 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:46.785136 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-59e9fa30-6c4e-4058-b430-ef8bd06451b4 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:46.839320 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [req-43b381a0-a7b9-4791-aa98-1ab245034e32 req-465fd679-1be3-4870-afdf-246ee3da7c19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8", "name": "network-vif-plugged", "status": "completed", "tag": "823b7d46-8462-4945-943b-09a9fc1c8dce"}]} {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 23:02:46.848878 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-43b381a0-a7b9-4791-aa98-1ab245034e32 req-465fd679-1be3-4870-afdf-246ee3da7c19 service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:46.849602 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-43b381a0-a7b9-4791-aa98-1ab245034e32 req-465fd679-1be3-4870-afdf-246ee3da7c19 service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:46.879918 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.compute.server_external_events [req-43b381a0-a7b9-4791-aa98-1ab245034e32 req-465fd679-1be3-4870-afdf-246ee3da7c19 service nova] Creating event network-vif-plugged:823b7d46-8462-4945-943b-09a9fc1c8dce for instance 8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8 on hv-cinder-84623 Jun 16 23:02:46.893210 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [req-43b381a0-a7b9-4791-aa98-1ab245034e32 req-465fd679-1be3-4870-afdf-246ee3da7c19 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057403 Jun 16 23:02:46.894299 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 158/312] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 23:02:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 23:02:47.024566 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-59e9fa30-6c4e-4058-b430-ef8bd06451b4 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '243e592fbf1844d89f55dd5035a684f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60447df5461141e883d207e028b74bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:02:47.037556 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-59e9fa30-6c4e-4058-b430-ef8bd06451b4 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] 10.222.0.17 "GET /compute/v2.1/servers/8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8" status: 200 len: 1370 microversion: 2.1 time: 0.285452 Jun 16 23:02:47.047925 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 155/313] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:02:46 2022] GET /compute/v2.1/servers/8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8 => generated 1370 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:02:47.433697 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-490b543d-bf41-4c33-9b67-06f437917c94 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:02:47.434645 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-490b543d-bf41-4c33-9b67-06f437917c94 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] [instance: aa81794d-bc81-49d2-b4dc-6f57b43ecfe8] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:02:47.444120 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-490b543d-bf41-4c33-9b67-06f437917c94 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:47.444120 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-490b543d-bf41-4c33-9b67-06f437917c94 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:47.444120 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-490b543d-bf41-4c33-9b67-06f437917c94 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:47.444120 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-490b543d-bf41-4c33-9b67-06f437917c94 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:47.604326 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-490b543d-bf41-4c33-9b67-06f437917c94 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01dd0e5661f44d05a01d7a5e82dbadf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b30b90ec4d5e45468a4fa0fb98e46393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:02:47.615713 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-490b543d-bf41-4c33-9b67-06f437917c94 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] 10.222.0.17 "GET /compute/v2.1/servers/aa81794d-bc81-49d2-b4dc-6f57b43ecfe8" status: 200 len: 1259 microversion: 2.1 time: 0.186160 Jun 16 23:02:47.616422 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 159/314] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:02:47 2022] GET /compute/v2.1/servers/aa81794d-bc81-49d2-b4dc-6f57b43ecfe8 => generated 1259 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:02:48.057309 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-b42eac8c-e32c-4e3e-8989-936a0ef7e209 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:02:48.057854 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-b42eac8c-e32c-4e3e-8989-936a0ef7e209 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] [instance: 8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:02:48.065784 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-b42eac8c-e32c-4e3e-8989-936a0ef7e209 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:48.066238 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-b42eac8c-e32c-4e3e-8989-936a0ef7e209 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:48.067053 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-b42eac8c-e32c-4e3e-8989-936a0ef7e209 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:48.067744 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-b42eac8c-e32c-4e3e-8989-936a0ef7e209 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:48.159876 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-d84b36bd-6084-4df3-8e70-66499a57285c tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:02:48.160774 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-d84b36bd-6084-4df3-8e70-66499a57285c tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] [instance: 5cfd118b-cc42-4dbe-93f1-784454892318] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:02:48.168543 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-d84b36bd-6084-4df3-8e70-66499a57285c tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:48.169285 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-d84b36bd-6084-4df3-8e70-66499a57285c tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:48.170266 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-d84b36bd-6084-4df3-8e70-66499a57285c tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:48.171166 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-d84b36bd-6084-4df3-8e70-66499a57285c tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:48.206540 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-d84b36bd-6084-4df3-8e70-66499a57285c tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] 10.222.0.17 "GET /compute/v2.1/servers/5cfd118b-cc42-4dbe-93f1-784454892318/ips" status: 200 len: 149 microversion: 2.1 time: 0.050488 Jun 16 23:02:48.208005 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 160/315] 10.222.0.17 () {58 vars in 1247 bytes} [Thu Jun 16 23:02:48 2022] GET /compute/v2.1/servers/5cfd118b-cc42-4dbe-93f1-784454892318/ips => generated 149 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 23:02:48.263237 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-b42eac8c-e32c-4e3e-8989-936a0ef7e209 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '243e592fbf1844d89f55dd5035a684f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60447df5461141e883d207e028b74bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:02:48.273925 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-b42eac8c-e32c-4e3e-8989-936a0ef7e209 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] 10.222.0.17 "GET /compute/v2.1/servers/8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8" status: 200 len: 1370 microversion: 2.1 time: 0.222686 Jun 16 23:02:48.278232 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 156/316] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:02:48 2022] GET /compute/v2.1/servers/8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8 => generated 1370 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:02:48.636572 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-9c4dcbe8-b7ef-4382-a017-e49ee20ada52 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:02:48.637190 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-9c4dcbe8-b7ef-4382-a017-e49ee20ada52 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] [instance: aa81794d-bc81-49d2-b4dc-6f57b43ecfe8] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:02:48.648022 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-9c4dcbe8-b7ef-4382-a017-e49ee20ada52 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:48.652650 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-9c4dcbe8-b7ef-4382-a017-e49ee20ada52 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:48.655674 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-9c4dcbe8-b7ef-4382-a017-e49ee20ada52 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:48.658562 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-9c4dcbe8-b7ef-4382-a017-e49ee20ada52 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:48.806183 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-9c4dcbe8-b7ef-4382-a017-e49ee20ada52 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01dd0e5661f44d05a01d7a5e82dbadf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b30b90ec4d5e45468a4fa0fb98e46393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:02:48.814666 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-9c4dcbe8-b7ef-4382-a017-e49ee20ada52 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] 10.222.0.17 "GET /compute/v2.1/servers/aa81794d-bc81-49d2-b4dc-6f57b43ecfe8" status: 200 len: 1443 microversion: 2.1 time: 0.184170 Jun 16 23:02:48.815311 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 161/317] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:02:48 2022] GET /compute/v2.1/servers/aa81794d-bc81-49d2-b4dc-6f57b43ecfe8 => generated 1443 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:02:48.831150 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-ef76a9ea-46e3-433d-8bb9-2303aac76137 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:02:48.831766 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-ef76a9ea-46e3-433d-8bb9-2303aac76137 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] [instance: aa81794d-bc81-49d2-b4dc-6f57b43ecfe8] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:02:48.838062 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-ef76a9ea-46e3-433d-8bb9-2303aac76137 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:48.838518 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-ef76a9ea-46e3-433d-8bb9-2303aac76137 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:48.839327 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-ef76a9ea-46e3-433d-8bb9-2303aac76137 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:48.839774 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-ef76a9ea-46e3-433d-8bb9-2303aac76137 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:48.974899 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-ef76a9ea-46e3-433d-8bb9-2303aac76137 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01dd0e5661f44d05a01d7a5e82dbadf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b30b90ec4d5e45468a4fa0fb98e46393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:02:48.985079 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-ef76a9ea-46e3-433d-8bb9-2303aac76137 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] 10.222.0.17 "GET /compute/v2.1/servers/aa81794d-bc81-49d2-b4dc-6f57b43ecfe8" status: 200 len: 1443 microversion: 2.1 time: 0.157792 Jun 16 23:02:48.985982 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 157/318] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:02:48 2022] GET /compute/v2.1/servers/aa81794d-bc81-49d2-b4dc-6f57b43ecfe8 => generated 1443 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:02:49.293791 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-846e72d6-89df-4a38-932e-5fa12755fc72 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:02:49.294700 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-846e72d6-89df-4a38-932e-5fa12755fc72 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] [instance: 8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:02:49.301750 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-846e72d6-89df-4a38-932e-5fa12755fc72 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:49.302549 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-846e72d6-89df-4a38-932e-5fa12755fc72 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:49.303549 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-846e72d6-89df-4a38-932e-5fa12755fc72 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:49.308039 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-846e72d6-89df-4a38-932e-5fa12755fc72 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:49.517400 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-846e72d6-89df-4a38-932e-5fa12755fc72 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '243e592fbf1844d89f55dd5035a684f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60447df5461141e883d207e028b74bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:02:49.525584 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-846e72d6-89df-4a38-932e-5fa12755fc72 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] 10.222.0.17 "GET /compute/v2.1/servers/8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8" status: 200 len: 1370 microversion: 2.1 time: 0.236968 Jun 16 23:02:49.526141 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 162/319] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:02:49 2022] GET /compute/v2.1/servers/8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8 => generated 1370 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:02:49.678692 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-674a15af-0bd9-4a32-ae7b-371c434ccc9a tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2206e81b-0e64-49bd-bc05-08fb12cab02d"}} {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 23:02:49.680832 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-674a15af-0bd9-4a32-ae7b-371c434ccc9a tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] [instance: 5cfd118b-cc42-4dbe-93f1-784454892318] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:02:49.690318 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-674a15af-0bd9-4a32-ae7b-371c434ccc9a tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:49.691010 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-674a15af-0bd9-4a32-ae7b-371c434ccc9a tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:49.692013 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-674a15af-0bd9-4a32-ae7b-371c434ccc9a tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:49.692654 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-674a15af-0bd9-4a32-ae7b-371c434ccc9a tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:49.820036 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-acc82182-1a48-4f18-b99d-17281911dd8c tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 23:02:49.820697 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-acc82182-1a48-4f18-b99d-17281911dd8c tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 46f43909-d681-4938-8253-5080b626e169] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:02:49.827248 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-acc82182-1a48-4f18-b99d-17281911dd8c tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:49.827699 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-acc82182-1a48-4f18-b99d-17281911dd8c tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:49.828477 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-acc82182-1a48-4f18-b99d-17281911dd8c tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:49.828932 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-acc82182-1a48-4f18-b99d-17281911dd8c tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:49.854780 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.objects.instance [None req-acc82182-1a48-4f18-b99d-17281911dd8c tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lazy-loading 'flavor' on Instance uuid 46f43909-d681-4938-8253-5080b626e169 {{(pid=117563) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 23:02:50.190779 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-acc82182-1a48-4f18-b99d-17281911dd8c tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "POST /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169/action" status: 202 len: 0 microversion: 2.20 time: 0.374740 Jun 16 23:02:50.194921 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 163/320] 10.222.0.17 () {62 vars in 1318 bytes} [Thu Jun 16 23:02:49 2022] POST /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169/action => generated 0 bytes in 376 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jun 16 23:02:50.200093 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-126d1db5-3a54-40ce-a92e-2b49c044acb7 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:02:50.200869 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-126d1db5-3a54-40ce-a92e-2b49c044acb7 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 46f43909-d681-4938-8253-5080b626e169] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:02:50.208039 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-126d1db5-3a54-40ce-a92e-2b49c044acb7 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:50.208487 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-126d1db5-3a54-40ce-a92e-2b49c044acb7 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:50.209264 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-126d1db5-3a54-40ce-a92e-2b49c044acb7 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:50.209708 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-126d1db5-3a54-40ce-a92e-2b49c044acb7 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:50.662984 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-126d1db5-3a54-40ce-a92e-2b49c044acb7 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:02:50.677845 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-126d1db5-3a54-40ce-a92e-2b49c044acb7 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:02:50.679954 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-126d1db5-3a54-40ce-a92e-2b49c044acb7 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:02:50.681385 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-126d1db5-3a54-40ce-a92e-2b49c044acb7 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169" status: 200 len: 1723 microversion: 2.20 time: 0.485189 Jun 16 23:02:50.682049 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 164/321] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 23:02:50 2022] GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169 => generated 1723 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 23:02:50.687962 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-618f3259-5e16-46e6-9caf-711ec175eae2 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:02:50.689399 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-618f3259-5e16-46e6-9caf-711ec175eae2 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] [instance: 8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:02:50.696577 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-618f3259-5e16-46e6-9caf-711ec175eae2 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:50.697167 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-618f3259-5e16-46e6-9caf-711ec175eae2 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:50.698096 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-618f3259-5e16-46e6-9caf-711ec175eae2 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:50.698663 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-618f3259-5e16-46e6-9caf-711ec175eae2 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:50.810170 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-674a15af-0bd9-4a32-ae7b-371c434ccc9a tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] 10.222.0.17 "POST /compute/v2.1/servers/5cfd118b-cc42-4dbe-93f1-784454892318/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.134696 Jun 16 23:02:50.811986 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 158/322] 10.222.0.17 () {60 vars in 1322 bytes} [Thu Jun 16 23:02:49 2022] POST /compute/v2.1/servers/5cfd118b-cc42-4dbe-93f1-784454892318/os-volume_attachments => generated 194 bytes in 1138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 23:02:50.923706 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-618f3259-5e16-46e6-9caf-711ec175eae2 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '243e592fbf1844d89f55dd5035a684f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60447df5461141e883d207e028b74bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:02:50.937147 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-618f3259-5e16-46e6-9caf-711ec175eae2 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] 10.222.0.17 "GET /compute/v2.1/servers/8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8" status: 200 len: 1564 microversion: 2.1 time: 0.253047 Jun 16 23:02:50.938408 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 165/323] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:02:50 2022] GET /compute/v2.1/servers/8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8 => generated 1564 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:02:50.962896 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-4f40907a-9760-486f-961c-6a63203266f2 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:02:50.963751 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-4f40907a-9760-486f-961c-6a63203266f2 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] [instance: 8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:02:50.970763 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG dbcounter [-] [117562] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=117562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 23:02:50.973264 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-4f40907a-9760-486f-961c-6a63203266f2 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:50.974253 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-4f40907a-9760-486f-961c-6a63203266f2 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:50.975477 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-4f40907a-9760-486f-961c-6a63203266f2 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:50.977002 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-4f40907a-9760-486f-961c-6a63203266f2 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:51.124939 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-4f40907a-9760-486f-961c-6a63203266f2 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] 10.222.0.17 "GET /compute/v2.1/servers/8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.171483 Jun 16 23:02:51.125550 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 159/324] 10.222.0.17 () {58 vars in 1274 bytes} [Thu Jun 16 23:02:50 2022] GET /compute/v2.1/servers/8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8/os-interface => generated 284 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 23:02:51.529775 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [req-29a7bcaf-419c-4c85-b521-df4070b46e7b req-877c9d31-b8db-4965-949b-7c0e9e0afb2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa81794d-bc81-49d2-b4dc-6f57b43ecfe8", "tag": "218d229b-a7e5-4c33-9723-c6215e47e600"}]} {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 23:02:51.543401 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-29a7bcaf-419c-4c85-b521-df4070b46e7b req-877c9d31-b8db-4965-949b-7c0e9e0afb2b service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:51.544106 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-29a7bcaf-419c-4c85-b521-df4070b46e7b req-877c9d31-b8db-4965-949b-7c0e9e0afb2b service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:51.559698 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.compute.server_external_events [req-29a7bcaf-419c-4c85-b521-df4070b46e7b req-877c9d31-b8db-4965-949b-7c0e9e0afb2b service nova] Creating event network-changed:218d229b-a7e5-4c33-9723-c6215e47e600 for instance aa81794d-bc81-49d2-b4dc-6f57b43ecfe8 on hv-cinder-84623 Jun 16 23:02:51.570396 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [req-29a7bcaf-419c-4c85-b521-df4070b46e7b req-877c9d31-b8db-4965-949b-7c0e9e0afb2b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043330 Jun 16 23:02:51.573407 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 166/325] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 23:02:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 23:02:51.716629 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-35530d2f-53f6-48fd-ab53-1ab0fbbe1fe1 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:02:51.717925 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-35530d2f-53f6-48fd-ab53-1ab0fbbe1fe1 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 46f43909-d681-4938-8253-5080b626e169] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:02:51.726020 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-35530d2f-53f6-48fd-ab53-1ab0fbbe1fe1 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:51.726752 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-35530d2f-53f6-48fd-ab53-1ab0fbbe1fe1 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:51.727960 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-35530d2f-53f6-48fd-ab53-1ab0fbbe1fe1 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:51.728641 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-35530d2f-53f6-48fd-ab53-1ab0fbbe1fe1 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:51.896636 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-35530d2f-53f6-48fd-ab53-1ab0fbbe1fe1 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:02:51.907145 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-35530d2f-53f6-48fd-ab53-1ab0fbbe1fe1 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:02:51.908948 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-35530d2f-53f6-48fd-ab53-1ab0fbbe1fe1 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:02:51.910115 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-35530d2f-53f6-48fd-ab53-1ab0fbbe1fe1 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169" status: 200 len: 1723 microversion: 2.20 time: 0.211258 Jun 16 23:02:51.921545 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 160/326] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 23:02:51 2022] GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169 => generated 1723 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 23:02:52.939686 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-7e06c332-61e4-469a-8350-e590fa741b99 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:02:52.940225 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-7e06c332-61e4-469a-8350-e590fa741b99 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 46f43909-d681-4938-8253-5080b626e169] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:02:52.956946 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-7e06c332-61e4-469a-8350-e590fa741b99 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:52.957472 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-7e06c332-61e4-469a-8350-e590fa741b99 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:52.958309 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-7e06c332-61e4-469a-8350-e590fa741b99 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:52.958784 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-7e06c332-61e4-469a-8350-e590fa741b99 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:53.142365 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [req-702cf38f-0f1a-40f9-b8fa-da05a590231b req-bc90c640-018e-4c63-88dd-add31d05c8a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8", "tag": "823b7d46-8462-4945-943b-09a9fc1c8dce"}]} {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 23:02:53.153344 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [req-702cf38f-0f1a-40f9-b8fa-da05a590231b req-bc90c640-018e-4c63-88dd-add31d05c8a9 service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:53.154073 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [req-702cf38f-0f1a-40f9-b8fa-da05a590231b req-bc90c640-018e-4c63-88dd-add31d05c8a9 service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:53.173990 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-7e06c332-61e4-469a-8350-e590fa741b99 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:02:53.177778 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.compute.server_external_events [req-702cf38f-0f1a-40f9-b8fa-da05a590231b req-bc90c640-018e-4c63-88dd-add31d05c8a9 service nova] Creating event network-changed:823b7d46-8462-4945-943b-09a9fc1c8dce for instance 8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8 on hv-cinder-84623 Jun 16 23:02:53.185237 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-7e06c332-61e4-469a-8350-e590fa741b99 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:02:53.186767 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-7e06c332-61e4-469a-8350-e590fa741b99 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:02:53.187955 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-7e06c332-61e4-469a-8350-e590fa741b99 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169" status: 200 len: 1723 microversion: 2.20 time: 0.262425 Jun 16 23:02:53.189331 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [req-702cf38f-0f1a-40f9-b8fa-da05a590231b req-bc90c640-018e-4c63-88dd-add31d05c8a9 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051076 Jun 16 23:02:53.189611 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 167/327] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 23:02:52 2022] GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169 => generated 1723 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 23:02:53.190158 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 161/328] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 23:02:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 23:02:54.208084 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-5c8d7e20-e0ee-4344-92e3-2fc04259075a tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:02:54.209689 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-5c8d7e20-e0ee-4344-92e3-2fc04259075a tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 46f43909-d681-4938-8253-5080b626e169] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:02:54.234956 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-5c8d7e20-e0ee-4344-92e3-2fc04259075a tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:54.236243 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-5c8d7e20-e0ee-4344-92e3-2fc04259075a tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:54.238450 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-5c8d7e20-e0ee-4344-92e3-2fc04259075a tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:54.238450 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-5c8d7e20-e0ee-4344-92e3-2fc04259075a tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:54.260394 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-e63dc846-02f5-4a7e-9192-dc99fec110bd tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 23:02:54.268894 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-e63dc846-02f5-4a7e-9192-dc99fec110bd tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:54.269819 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-e63dc846-02f5-4a7e-9192-dc99fec110bd tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:54.356706 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-e63dc846-02f5-4a7e-9192-dc99fec110bd tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] [instance: f4c73822-1dfa-4eed-bf02-1123b0402755] Going to try to stop instance {{(pid=117562) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 16 23:02:54.415486 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-e63dc846-02f5-4a7e-9192-dc99fec110bd tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] 10.222.0.17 "POST /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755/action" status: 202 len: 0 microversion: 2.1 time: 0.160989 Jun 16 23:02:54.423754 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 162/329] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Jun 16 23:02:54 2022] POST /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755/action => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 23:02:54.446074 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-7d3d0b78-fc23-4bb0-ba0c-ea9c4ae503af tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:02:54.447042 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-7d3d0b78-fc23-4bb0-ba0c-ea9c4ae503af tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] [instance: f4c73822-1dfa-4eed-bf02-1123b0402755] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:02:54.463379 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-7d3d0b78-fc23-4bb0-ba0c-ea9c4ae503af tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:54.463934 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-7d3d0b78-fc23-4bb0-ba0c-ea9c4ae503af tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:54.464877 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-7d3d0b78-fc23-4bb0-ba0c-ea9c4ae503af tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:54.465591 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-7d3d0b78-fc23-4bb0-ba0c-ea9c4ae503af tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:54.487530 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG dbcounter [-] [117562] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=117562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 23:02:54.527812 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-5c8d7e20-e0ee-4344-92e3-2fc04259075a tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:02:54.540951 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-5c8d7e20-e0ee-4344-92e3-2fc04259075a tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:02:54.543447 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-5c8d7e20-e0ee-4344-92e3-2fc04259075a tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:02:54.545304 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-5c8d7e20-e0ee-4344-92e3-2fc04259075a tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169" status: 200 len: 1723 microversion: 2.20 time: 0.341480 Jun 16 23:02:54.557923 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 168/330] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 23:02:54 2022] GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169 => generated 1723 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 23:02:54.700427 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-7d3d0b78-fc23-4bb0-ba0c-ea9c4ae503af tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a993f5d14b64fccad723abecfcadf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b1be8431b0434d8bd6abca293127d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:02:54.717683 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-7d3d0b78-fc23-4bb0-ba0c-ea9c4ae503af tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] 10.222.0.17 "GET /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755" status: 200 len: 1723 microversion: 2.1 time: 0.291785 Jun 16 23:02:54.719305 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 163/331] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:02:54 2022] GET /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755 => generated 1723 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:02:55.565520 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-10464e24-1170-45da-a33f-53553dda899f tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:02:55.566124 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-10464e24-1170-45da-a33f-53553dda899f tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 46f43909-d681-4938-8253-5080b626e169] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:02:55.573064 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-10464e24-1170-45da-a33f-53553dda899f tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:55.573518 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-10464e24-1170-45da-a33f-53553dda899f tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:55.574292 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-10464e24-1170-45da-a33f-53553dda899f tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:55.574770 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-10464e24-1170-45da-a33f-53553dda899f tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:55.721737 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-10464e24-1170-45da-a33f-53553dda899f tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:02:55.730252 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-10464e24-1170-45da-a33f-53553dda899f tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:02:55.732079 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-10464e24-1170-45da-a33f-53553dda899f tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:02:55.733511 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-10464e24-1170-45da-a33f-53553dda899f tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169" status: 200 len: 1723 microversion: 2.20 time: 0.172111 Jun 16 23:02:55.734071 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 169/332] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 23:02:55 2022] GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169 => generated 1723 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 23:02:55.737330 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-169fcd70-688a-48f6-bf8b-2036f9e734bc tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:02:55.737942 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-169fcd70-688a-48f6-bf8b-2036f9e734bc tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] [instance: f4c73822-1dfa-4eed-bf02-1123b0402755] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:02:55.744637 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-169fcd70-688a-48f6-bf8b-2036f9e734bc tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:55.745093 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-169fcd70-688a-48f6-bf8b-2036f9e734bc tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:55.745865 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-169fcd70-688a-48f6-bf8b-2036f9e734bc tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:55.746303 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-169fcd70-688a-48f6-bf8b-2036f9e734bc tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:55.892079 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-169fcd70-688a-48f6-bf8b-2036f9e734bc tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a993f5d14b64fccad723abecfcadf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b1be8431b0434d8bd6abca293127d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:02:55.901148 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-169fcd70-688a-48f6-bf8b-2036f9e734bc tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] 10.222.0.17 "GET /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755" status: 200 len: 1723 microversion: 2.1 time: 0.167763 Jun 16 23:02:55.901703 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 164/333] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:02:55 2022] GET /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755 => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 23:02:56.752685 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-b265bc3a-223e-4cb7-9a23-d9ca02e96879 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:02:56.754294 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-b265bc3a-223e-4cb7-9a23-d9ca02e96879 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 46f43909-d681-4938-8253-5080b626e169] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:02:56.764325 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-b265bc3a-223e-4cb7-9a23-d9ca02e96879 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:56.764961 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-b265bc3a-223e-4cb7-9a23-d9ca02e96879 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:56.766687 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-b265bc3a-223e-4cb7-9a23-d9ca02e96879 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:56.767320 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-b265bc3a-223e-4cb7-9a23-d9ca02e96879 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:56.919490 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-afab3b96-1f67-4855-8369-fb0aa236f832 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:02:56.921262 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-afab3b96-1f67-4855-8369-fb0aa236f832 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] [instance: f4c73822-1dfa-4eed-bf02-1123b0402755] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:02:56.923310 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-b265bc3a-223e-4cb7-9a23-d9ca02e96879 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:02:56.930058 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-afab3b96-1f67-4855-8369-fb0aa236f832 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:56.930514 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-afab3b96-1f67-4855-8369-fb0aa236f832 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:56.931456 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-afab3b96-1f67-4855-8369-fb0aa236f832 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:56.931777 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-b265bc3a-223e-4cb7-9a23-d9ca02e96879 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:02:56.931941 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-afab3b96-1f67-4855-8369-fb0aa236f832 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:56.935280 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-b265bc3a-223e-4cb7-9a23-d9ca02e96879 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:02:56.936437 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-b265bc3a-223e-4cb7-9a23-d9ca02e96879 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169" status: 200 len: 1723 microversion: 2.20 time: 0.188379 Jun 16 23:02:56.948987 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 170/334] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 23:02:56 2022] GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169 => generated 1723 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 23:02:57.082133 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-afab3b96-1f67-4855-8369-fb0aa236f832 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a993f5d14b64fccad723abecfcadf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b1be8431b0434d8bd6abca293127d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:02:57.090058 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-afab3b96-1f67-4855-8369-fb0aa236f832 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] 10.222.0.17 "GET /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755" status: 200 len: 1723 microversion: 2.1 time: 0.175201 Jun 16 23:02:57.090648 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 165/335] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:02:56 2022] GET /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755 => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:02:57.956305 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-0c9ed8e0-b1ef-42c7-a1c0-fa6af5931f53 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:02:57.956919 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-0c9ed8e0-b1ef-42c7-a1c0-fa6af5931f53 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 46f43909-d681-4938-8253-5080b626e169] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:02:57.964019 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-0c9ed8e0-b1ef-42c7-a1c0-fa6af5931f53 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:57.964467 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-0c9ed8e0-b1ef-42c7-a1c0-fa6af5931f53 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:57.965228 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-0c9ed8e0-b1ef-42c7-a1c0-fa6af5931f53 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:57.965662 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-0c9ed8e0-b1ef-42c7-a1c0-fa6af5931f53 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:57.984271 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG dbcounter [-] [117563] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 23:02:58.105259 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-0c9ed8e0-b1ef-42c7-a1c0-fa6af5931f53 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:02:58.109394 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-ae676a13-a432-43e6-abf9-84b653574a70 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:02:58.110009 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-ae676a13-a432-43e6-abf9-84b653574a70 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] [instance: f4c73822-1dfa-4eed-bf02-1123b0402755] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:02:58.113839 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-0c9ed8e0-b1ef-42c7-a1c0-fa6af5931f53 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:02:58.115921 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-0c9ed8e0-b1ef-42c7-a1c0-fa6af5931f53 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:02:58.117122 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-ae676a13-a432-43e6-abf9-84b653574a70 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:58.117235 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-0c9ed8e0-b1ef-42c7-a1c0-fa6af5931f53 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169" status: 200 len: 1723 microversion: 2.20 time: 0.164765 Jun 16 23:02:58.117581 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-ae676a13-a432-43e6-abf9-84b653574a70 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:58.126922 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 171/336] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 23:02:57 2022] GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 23:02:58.127072 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-ae676a13-a432-43e6-abf9-84b653574a70 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:58.127072 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-ae676a13-a432-43e6-abf9-84b653574a70 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:58.251428 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-ae676a13-a432-43e6-abf9-84b653574a70 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a993f5d14b64fccad723abecfcadf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b1be8431b0434d8bd6abca293127d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:02:58.260737 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-ae676a13-a432-43e6-abf9-84b653574a70 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] 10.222.0.17 "GET /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755" status: 200 len: 1723 microversion: 2.1 time: 0.155234 Jun 16 23:02:58.261307 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 166/337] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:02:58 2022] GET /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 23:02:58.701410 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-eb5d77e9-b57c-4f81-8685-88efe0499a34 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1357942601", "imageRef": "2b486731-e5ea-4159-b6b1-ed0083e00543", "flavorRef": "452", "networks": [{"uuid": "47420daf-a76e-49b0-bb23-482a9b944fce"}]}} {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 23:02:58.750634 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.network.neutron [None req-eb5d77e9-b57c-4f81-8685-88efe0499a34 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] validate_networks() for [('47420daf-a76e-49b0-bb23-482a9b944fce', None, None, None, None, None)] {{(pid=117563) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 23:02:59.119663 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.virt.hardware [None req-eb5d77e9-b57c-4f81-8685-88efe0499a34 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Flavor limits 0:0:0 {{(pid=117563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 23:02:59.120252 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.virt.hardware [None req-eb5d77e9-b57c-4f81-8685-88efe0499a34 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Image limits 0:0:0 {{(pid=117563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 23:02:59.120550 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.virt.hardware [None req-eb5d77e9-b57c-4f81-8685-88efe0499a34 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Flavor pref 0:0:0 {{(pid=117563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 23:02:59.120961 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.virt.hardware [None req-eb5d77e9-b57c-4f81-8685-88efe0499a34 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Image pref 0:0:0 {{(pid=117563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 23:02:59.121370 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.virt.hardware [None req-eb5d77e9-b57c-4f81-8685-88efe0499a34 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 23:02:59.133764 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-eb5d77e9-b57c-4f81-8685-88efe0499a34 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:59.134225 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-eb5d77e9-b57c-4f81-8685-88efe0499a34 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:59.135061 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-eb5d77e9-b57c-4f81-8685-88efe0499a34 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:59.135505 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-eb5d77e9-b57c-4f81-8685-88efe0499a34 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:59.136044 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-b9c1b13d-f666-4054-ba80-7bb9f41ca655 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:02:59.137287 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-b9c1b13d-f666-4054-ba80-7bb9f41ca655 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 46f43909-d681-4938-8253-5080b626e169] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:02:59.144713 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-b9c1b13d-f666-4054-ba80-7bb9f41ca655 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:59.145396 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-b9c1b13d-f666-4054-ba80-7bb9f41ca655 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:59.146240 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-b9c1b13d-f666-4054-ba80-7bb9f41ca655 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:59.147069 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-b9c1b13d-f666-4054-ba80-7bb9f41ca655 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:59.153132 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.quota [None req-eb5d77e9-b57c-4f81-8685-88efe0499a34 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Getting quotas for project 9761759a69724a21b0b9315a931b106f. Resources: {'instances', 'cores', 'ram'} {{(pid=117563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 23:02:59.157440 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.quota [None req-eb5d77e9-b57c-4f81-8685-88efe0499a34 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Getting quotas for user 69163c28aa75492aa01c70532bed15a9 and project 9761759a69724a21b0b9315a931b106f. Resources: {'instances', 'cores', 'ram'} {{(pid=117563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 23:02:59.169817 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-eb5d77e9-b57c-4f81-8685-88efe0499a34 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Going to run 1 instances... {{(pid=117563) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 23:02:59.172124 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-eb5d77e9-b57c-4f81-8685-88efe0499a34 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] [instance: 7e6c1a21-fd9c-4f9e-a23f-f2cacbdd2e7b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2b486731-e5ea-4159-b6b1-ed0083e00543',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117563) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 23:02:59.217472 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-eb5d77e9-b57c-4f81-8685-88efe0499a34 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.519816 Jun 16 23:02:59.218688 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 172/338] 10.222.0.17 () {60 vars in 1146 bytes} [Thu Jun 16 23:02:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 521 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 23:02:59.229304 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-1654e17b-f950-4081-9cf5-437c70bdd352 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:02:59.229844 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-1654e17b-f950-4081-9cf5-437c70bdd352 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] [instance: 7e6c1a21-fd9c-4f9e-a23f-f2cacbdd2e7b] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:02:59.303552 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-1654e17b-f950-4081-9cf5-437c70bdd352 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69163c28aa75492aa01c70532bed15a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9761759a69724a21b0b9315a931b106f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:02:59.313322 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-1654e17b-f950-4081-9cf5-437c70bdd352 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] 10.222.0.17 "GET /compute/v2.1/servers/7e6c1a21-fd9c-4f9e-a23f-f2cacbdd2e7b" status: 200 len: 1219 microversion: 2.1 time: 0.086951 Jun 16 23:02:59.314651 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 173/339] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:02:59 2022] GET /compute/v2.1/servers/7e6c1a21-fd9c-4f9e-a23f-f2cacbdd2e7b => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:02:59.325695 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-5e886310-c558-4c8a-a1a8-eb3f1c9b3c87 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:02:59.325958 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-5e886310-c558-4c8a-a1a8-eb3f1c9b3c87 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] [instance: f4c73822-1dfa-4eed-bf02-1123b0402755] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:02:59.334392 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-5e886310-c558-4c8a-a1a8-eb3f1c9b3c87 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:59.335107 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-5e886310-c558-4c8a-a1a8-eb3f1c9b3c87 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:59.335886 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-5e886310-c558-4c8a-a1a8-eb3f1c9b3c87 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:02:59.336319 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-5e886310-c558-4c8a-a1a8-eb3f1c9b3c87 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:02:59.344301 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-b9c1b13d-f666-4054-ba80-7bb9f41ca655 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:02:59.352978 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-b9c1b13d-f666-4054-ba80-7bb9f41ca655 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:02:59.354538 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-b9c1b13d-f666-4054-ba80-7bb9f41ca655 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:02:59.355652 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-b9c1b13d-f666-4054-ba80-7bb9f41ca655 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169" status: 200 len: 1723 microversion: 2.20 time: 0.223493 Jun 16 23:02:59.356369 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 167/340] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 23:02:59 2022] GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169 => generated 1723 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 23:02:59.480990 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-5e886310-c558-4c8a-a1a8-eb3f1c9b3c87 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a993f5d14b64fccad723abecfcadf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b1be8431b0434d8bd6abca293127d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:02:59.491420 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-5e886310-c558-4c8a-a1a8-eb3f1c9b3c87 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] 10.222.0.17 "GET /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755" status: 200 len: 1723 microversion: 2.1 time: 0.175333 Jun 16 23:02:59.492177 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 174/341] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:02:59 2022] GET /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755 => generated 1723 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:03:00.330979 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-91ceb67e-c30b-4231-8428-44b425db1f5d tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:03:00.331602 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-91ceb67e-c30b-4231-8428-44b425db1f5d tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] [instance: 7e6c1a21-fd9c-4f9e-a23f-f2cacbdd2e7b] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:03:00.339194 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-91ceb67e-c30b-4231-8428-44b425db1f5d tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:00.339733 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-91ceb67e-c30b-4231-8428-44b425db1f5d tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:00.340610 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-91ceb67e-c30b-4231-8428-44b425db1f5d tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:00.341061 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-91ceb67e-c30b-4231-8428-44b425db1f5d tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:00.374260 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-7a47394d-e55d-449f-a4d2-6b90eeabe13f tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:03:00.382926 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-7a47394d-e55d-449f-a4d2-6b90eeabe13f tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 46f43909-d681-4938-8253-5080b626e169] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:03:00.390490 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-7a47394d-e55d-449f-a4d2-6b90eeabe13f tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:00.390904 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-7a47394d-e55d-449f-a4d2-6b90eeabe13f tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:00.391699 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-7a47394d-e55d-449f-a4d2-6b90eeabe13f tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:00.392309 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-7a47394d-e55d-449f-a4d2-6b90eeabe13f tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:00.415779 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-91ceb67e-c30b-4231-8428-44b425db1f5d tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69163c28aa75492aa01c70532bed15a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9761759a69724a21b0b9315a931b106f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:03:00.426674 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-91ceb67e-c30b-4231-8428-44b425db1f5d tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] 10.222.0.17 "GET /compute/v2.1/servers/7e6c1a21-fd9c-4f9e-a23f-f2cacbdd2e7b" status: 200 len: 1215 microversion: 2.1 time: 0.099204 Jun 16 23:03:00.435837 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 168/342] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:03:00 2022] GET /compute/v2.1/servers/7e6c1a21-fd9c-4f9e-a23f-f2cacbdd2e7b => generated 1215 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:03:00.509065 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-b49f45ad-4f0a-439b-9c4e-4fee502fec21 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:03:00.509682 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-b49f45ad-4f0a-439b-9c4e-4fee502fec21 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] [instance: f4c73822-1dfa-4eed-bf02-1123b0402755] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:03:00.518019 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-b49f45ad-4f0a-439b-9c4e-4fee502fec21 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:00.518967 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-b49f45ad-4f0a-439b-9c4e-4fee502fec21 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:00.520118 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-b49f45ad-4f0a-439b-9c4e-4fee502fec21 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:00.520617 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-b49f45ad-4f0a-439b-9c4e-4fee502fec21 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:00.562674 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-7a47394d-e55d-449f-a4d2-6b90eeabe13f tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:03:00.572647 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-7a47394d-e55d-449f-a4d2-6b90eeabe13f tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:03:00.575174 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-7a47394d-e55d-449f-a4d2-6b90eeabe13f tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:03:00.576962 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-7a47394d-e55d-449f-a4d2-6b90eeabe13f tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169" status: 200 len: 1723 microversion: 2.20 time: 0.206894 Jun 16 23:03:00.588905 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 175/343] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 23:03:00 2022] GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169 => generated 1723 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 23:03:00.666912 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-b49f45ad-4f0a-439b-9c4e-4fee502fec21 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a993f5d14b64fccad723abecfcadf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b1be8431b0434d8bd6abca293127d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:03:00.674821 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-b49f45ad-4f0a-439b-9c4e-4fee502fec21 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] 10.222.0.17 "GET /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755" status: 200 len: 1723 microversion: 2.1 time: 0.169533 Jun 16 23:03:00.675378 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 169/344] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:03:00 2022] GET /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755 => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 23:03:01.443117 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-20d4b883-d138-413c-ac91-4635d3f02f44 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:03:01.443904 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-20d4b883-d138-413c-ac91-4635d3f02f44 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] [instance: 7e6c1a21-fd9c-4f9e-a23f-f2cacbdd2e7b] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:03:01.450442 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-20d4b883-d138-413c-ac91-4635d3f02f44 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:01.450921 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-20d4b883-d138-413c-ac91-4635d3f02f44 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:01.451688 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-20d4b883-d138-413c-ac91-4635d3f02f44 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:01.452314 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-20d4b883-d138-413c-ac91-4635d3f02f44 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:01.539135 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-20d4b883-d138-413c-ac91-4635d3f02f44 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69163c28aa75492aa01c70532bed15a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9761759a69724a21b0b9315a931b106f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:03:01.547518 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-20d4b883-d138-413c-ac91-4635d3f02f44 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] 10.222.0.17 "GET /compute/v2.1/servers/7e6c1a21-fd9c-4f9e-a23f-f2cacbdd2e7b" status: 200 len: 1271 microversion: 2.1 time: 0.108270 Jun 16 23:03:01.548781 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 176/345] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:03:01 2022] GET /compute/v2.1/servers/7e6c1a21-fd9c-4f9e-a23f-f2cacbdd2e7b => generated 1271 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:03:01.595241 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-c4df9a5a-aa57-46a0-9c27-25b871cb0c6f tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:03:01.596549 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-c4df9a5a-aa57-46a0-9c27-25b871cb0c6f tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 46f43909-d681-4938-8253-5080b626e169] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:03:01.604069 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-c4df9a5a-aa57-46a0-9c27-25b871cb0c6f tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:01.604798 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-c4df9a5a-aa57-46a0-9c27-25b871cb0c6f tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:01.605732 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-c4df9a5a-aa57-46a0-9c27-25b871cb0c6f tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:01.606419 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-c4df9a5a-aa57-46a0-9c27-25b871cb0c6f tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:01.692447 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-baf9f076-62fc-491b-aec7-f5b668a1aedc tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:03:01.703129 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-baf9f076-62fc-491b-aec7-f5b668a1aedc tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] [instance: f4c73822-1dfa-4eed-bf02-1123b0402755] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:03:01.716795 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-baf9f076-62fc-491b-aec7-f5b668a1aedc tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:01.719656 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-baf9f076-62fc-491b-aec7-f5b668a1aedc tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:01.721763 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-baf9f076-62fc-491b-aec7-f5b668a1aedc tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:01.723882 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-baf9f076-62fc-491b-aec7-f5b668a1aedc tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:01.800139 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-c4df9a5a-aa57-46a0-9c27-25b871cb0c6f tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:03:01.808913 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-c4df9a5a-aa57-46a0-9c27-25b871cb0c6f tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:03:01.810638 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-c4df9a5a-aa57-46a0-9c27-25b871cb0c6f tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:03:01.812080 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-c4df9a5a-aa57-46a0-9c27-25b871cb0c6f tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169" status: 200 len: 1723 microversion: 2.20 time: 0.220491 Jun 16 23:03:01.812814 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 170/346] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 23:03:01 2022] GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169 => generated 1723 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 23:03:01.821043 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-d3c6b7ad-13b8-4aad-9b63-28c293c5b3f3 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Action: 'create', calling method: .version_select at 0x7f53200394c0>, body: {"keypair": {"name": "tempest-keypair-1359086876", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOXKWlmVQT0TP6XVyWLP089qfr7S1+jChL2YBhJ7np18KAhK4a+3nVlZbiwqzwVA/mYkJB1S1zRS63fVxRM+RVkf9RST62eeOvNjo4c2yCNbKzWJDSQ0BIY37ZLu1CCiwQ=="}} {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 23:03:01.836403 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.quota [None req-d3c6b7ad-13b8-4aad-9b63-28c293c5b3f3 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Getting quotas for project 0526c12e8bc947209e24daf5ddfad7be. Resources: {'key_pairs'} {{(pid=117562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 23:03:01.841917 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.quota [None req-d3c6b7ad-13b8-4aad-9b63-28c293c5b3f3 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Getting quotas for user 9e3a2d16133b4af8a208682de8a7d111 and project 0526c12e8bc947209e24daf5ddfad7be. Resources: {'key_pairs'} {{(pid=117562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 23:03:01.875030 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-d3c6b7ad-13b8-4aad-9b63-28c293c5b3f3 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.060058 Jun 16 23:03:01.881400 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 171/347] 10.222.0.17 () {60 vars in 1158 bytes} [Thu Jun 16 23:03:01 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 23:03:01.964509 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-baf9f076-62fc-491b-aec7-f5b668a1aedc tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a993f5d14b64fccad723abecfcadf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b1be8431b0434d8bd6abca293127d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:03:01.973734 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-baf9f076-62fc-491b-aec7-f5b668a1aedc tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] 10.222.0.17 "GET /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755" status: 200 len: 1723 microversion: 2.1 time: 0.285372 Jun 16 23:03:01.984242 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 177/348] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:03:01 2022] GET /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755 => generated 1723 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 23:03:02.566876 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-e7442eec-a2b1-4d4c-8aac-d3d5bc1af846 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:03:02.567991 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-e7442eec-a2b1-4d4c-8aac-d3d5bc1af846 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] [instance: 7e6c1a21-fd9c-4f9e-a23f-f2cacbdd2e7b] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:03:02.576265 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-e7442eec-a2b1-4d4c-8aac-d3d5bc1af846 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:02.577235 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-e7442eec-a2b1-4d4c-8aac-d3d5bc1af846 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:02.579284 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-e7442eec-a2b1-4d4c-8aac-d3d5bc1af846 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:02.580059 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-e7442eec-a2b1-4d4c-8aac-d3d5bc1af846 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:02.832019 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-7ebe9c57-8748-4676-bff2-bc642aad19a5 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:03:02.833195 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-7ebe9c57-8748-4676-bff2-bc642aad19a5 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 46f43909-d681-4938-8253-5080b626e169] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:03:02.848802 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-7ebe9c57-8748-4676-bff2-bc642aad19a5 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:02.849520 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-7ebe9c57-8748-4676-bff2-bc642aad19a5 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:02.850997 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-7ebe9c57-8748-4676-bff2-bc642aad19a5 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:02.851743 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-7ebe9c57-8748-4676-bff2-bc642aad19a5 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:03.106326 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-e7442eec-a2b1-4d4c-8aac-d3d5bc1af846 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69163c28aa75492aa01c70532bed15a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9761759a69724a21b0b9315a931b106f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:03:03.115798 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-e7442eec-a2b1-4d4c-8aac-d3d5bc1af846 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] 10.222.0.17 "GET /compute/v2.1/servers/7e6c1a21-fd9c-4f9e-a23f-f2cacbdd2e7b" status: 200 len: 1319 microversion: 2.1 time: 0.553954 Jun 16 23:03:03.129517 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 172/349] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:03:02 2022] GET /compute/v2.1/servers/7e6c1a21-fd9c-4f9e-a23f-f2cacbdd2e7b => generated 1319 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 23:03:03.136153 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-4a04f125-514d-4bee-afaf-4e2f97d07629 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:03:03.137278 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-4a04f125-514d-4bee-afaf-4e2f97d07629 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] [instance: f4c73822-1dfa-4eed-bf02-1123b0402755] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:03:03.157105 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-4a04f125-514d-4bee-afaf-4e2f97d07629 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:03.157979 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-4a04f125-514d-4bee-afaf-4e2f97d07629 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:03.159254 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-4a04f125-514d-4bee-afaf-4e2f97d07629 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:03.160236 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-4a04f125-514d-4bee-afaf-4e2f97d07629 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:03.181666 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-7ebe9c57-8748-4676-bff2-bc642aad19a5 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:03:03.198847 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-7ebe9c57-8748-4676-bff2-bc642aad19a5 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:03:03.200534 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-7ebe9c57-8748-4676-bff2-bc642aad19a5 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:03:03.211147 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-7ebe9c57-8748-4676-bff2-bc642aad19a5 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169" status: 200 len: 1723 microversion: 2.20 time: 0.375164 Jun 16 23:03:03.212012 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 178/350] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 23:03:02 2022] GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169 => generated 1723 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 23:03:03.344683 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-4a04f125-514d-4bee-afaf-4e2f97d07629 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a993f5d14b64fccad723abecfcadf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b1be8431b0434d8bd6abca293127d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:03:03.357856 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-4a04f125-514d-4bee-afaf-4e2f97d07629 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] 10.222.0.17 "GET /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755" status: 200 len: 1723 microversion: 2.1 time: 0.226480 Jun 16 23:03:03.358797 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 173/351] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:03:03 2022] GET /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755 => generated 1723 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:03:03.707181 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [req-52d534b6-aef4-49d8-80d5-5283397e1212 req-96840b52-e275-4065-9983-6e6877eca935 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e6c1a21-fd9c-4f9e-a23f-f2cacbdd2e7b", "tag": "9f27a5db-37c7-4f56-a95a-f2cd921a04db"}]} {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 23:03:03.721690 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-52d534b6-aef4-49d8-80d5-5283397e1212 req-96840b52-e275-4065-9983-6e6877eca935 service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:03.722011 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-52d534b6-aef4-49d8-80d5-5283397e1212 req-96840b52-e275-4065-9983-6e6877eca935 service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:03.741176 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.compute.server_external_events [req-52d534b6-aef4-49d8-80d5-5283397e1212 req-96840b52-e275-4065-9983-6e6877eca935 service nova] Creating event network-changed:9f27a5db-37c7-4f56-a95a-f2cd921a04db for instance 7e6c1a21-fd9c-4f9e-a23f-f2cacbdd2e7b on hv-cinder-84623 Jun 16 23:03:03.746779 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [req-52d534b6-aef4-49d8-80d5-5283397e1212 req-96840b52-e275-4065-9983-6e6877eca935 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045040 Jun 16 23:03:03.747966 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 179/352] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 23:03:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 23:03:04.136482 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-61ef745b-2d27-45be-9ca6-93fc9652100c tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:03:04.137183 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-61ef745b-2d27-45be-9ca6-93fc9652100c tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] [instance: 7e6c1a21-fd9c-4f9e-a23f-f2cacbdd2e7b] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:03:04.144785 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-61ef745b-2d27-45be-9ca6-93fc9652100c tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:04.145548 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-61ef745b-2d27-45be-9ca6-93fc9652100c tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:04.148793 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-61ef745b-2d27-45be-9ca6-93fc9652100c tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:04.149242 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-61ef745b-2d27-45be-9ca6-93fc9652100c tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:04.152729 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-2e91593b-c56c-46c1-814f-f1f19b3a6425 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-277517769", "imageRef": "2b486731-e5ea-4159-b6b1-ed0083e00543", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "663ca997-5122-4586-973b-ea2e3ed98672"}], "security_groups": [{"name": "tempest-securitygroup--1159097250"}], "key_name": "tempest-keypair-1359086876", "user_data": "}} {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 23:03:04.318890 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.network.neutron [None req-2e91593b-c56c-46c1-814f-f1f19b3a6425 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] validate_networks() for [('663ca997-5122-4586-973b-ea2e3ed98672', None, None, None, None, None)] {{(pid=117563) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 23:03:04.377894 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-61ef745b-2d27-45be-9ca6-93fc9652100c tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69163c28aa75492aa01c70532bed15a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9761759a69724a21b0b9315a931b106f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:03:04.385620 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-61ef745b-2d27-45be-9ca6-93fc9652100c tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] 10.222.0.17 "GET /compute/v2.1/servers/7e6c1a21-fd9c-4f9e-a23f-f2cacbdd2e7b" status: 200 len: 1319 microversion: 2.1 time: 0.253060 Jun 16 23:03:04.387675 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 174/353] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:03:04 2022] GET /compute/v2.1/servers/7e6c1a21-fd9c-4f9e-a23f-f2cacbdd2e7b => generated 1319 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:03:04.392867 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-4f69e491-a382-4bf0-9a3b-882c21a4c564 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:03:04.393614 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-4f69e491-a382-4bf0-9a3b-882c21a4c564 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 46f43909-d681-4938-8253-5080b626e169] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:03:04.399779 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-4f69e491-a382-4bf0-9a3b-882c21a4c564 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:04.400235 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-4f69e491-a382-4bf0-9a3b-882c21a4c564 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:04.401004 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-4f69e491-a382-4bf0-9a3b-882c21a4c564 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:04.401442 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-4f69e491-a382-4bf0-9a3b-882c21a4c564 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:04.608362 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-4f69e491-a382-4bf0-9a3b-882c21a4c564 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:03:04.618524 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-4f69e491-a382-4bf0-9a3b-882c21a4c564 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:03:04.620897 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-4f69e491-a382-4bf0-9a3b-882c21a4c564 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:03:04.622675 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-4f69e491-a382-4bf0-9a3b-882c21a4c564 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169" status: 200 len: 1723 microversion: 2.20 time: 0.233726 Jun 16 23:03:04.623900 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 175/354] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 23:03:04 2022] GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169 => generated 1723 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 23:03:04.629320 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-46e0ce93-4935-4df9-b898-5eb56ed2ac98 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:03:04.630056 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-46e0ce93-4935-4df9-b898-5eb56ed2ac98 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] [instance: f4c73822-1dfa-4eed-bf02-1123b0402755] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:03:04.639604 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-46e0ce93-4935-4df9-b898-5eb56ed2ac98 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:04.640016 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-46e0ce93-4935-4df9-b898-5eb56ed2ac98 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:04.640803 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-46e0ce93-4935-4df9-b898-5eb56ed2ac98 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:04.641507 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-46e0ce93-4935-4df9-b898-5eb56ed2ac98 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:04.847453 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.virt.hardware [None req-2e91593b-c56c-46c1-814f-f1f19b3a6425 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Flavor limits 0:0:0 {{(pid=117563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 23:03:04.848233 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.virt.hardware [None req-2e91593b-c56c-46c1-814f-f1f19b3a6425 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Image limits 0:0:0 {{(pid=117563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 23:03:04.848765 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.virt.hardware [None req-2e91593b-c56c-46c1-814f-f1f19b3a6425 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Flavor pref 0:0:0 {{(pid=117563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 23:03:04.849637 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.virt.hardware [None req-2e91593b-c56c-46c1-814f-f1f19b3a6425 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Image pref 0:0:0 {{(pid=117563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 23:03:04.850058 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.virt.hardware [None req-2e91593b-c56c-46c1-814f-f1f19b3a6425 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 23:03:04.851850 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-46e0ce93-4935-4df9-b898-5eb56ed2ac98 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a993f5d14b64fccad723abecfcadf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b1be8431b0434d8bd6abca293127d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:03:04.858903 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-2e91593b-c56c-46c1-814f-f1f19b3a6425 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:04.859591 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-2e91593b-c56c-46c1-814f-f1f19b3a6425 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:04.859826 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-46e0ce93-4935-4df9-b898-5eb56ed2ac98 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] 10.222.0.17 "GET /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755" status: 200 len: 1723 microversion: 2.1 time: 0.234499 Jun 16 23:03:04.860398 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-2e91593b-c56c-46c1-814f-f1f19b3a6425 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:04.860538 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 176/355] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:03:04 2022] GET /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755 => generated 1723 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:03:04.861106 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-2e91593b-c56c-46c1-814f-f1f19b3a6425 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:04.879335 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.quota [None req-2e91593b-c56c-46c1-814f-f1f19b3a6425 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Getting quotas for project 0526c12e8bc947209e24daf5ddfad7be. Resources: {'instances', 'cores', 'ram'} {{(pid=117563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 23:03:04.884015 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.quota [None req-2e91593b-c56c-46c1-814f-f1f19b3a6425 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Getting quotas for user 9e3a2d16133b4af8a208682de8a7d111 and project 0526c12e8bc947209e24daf5ddfad7be. Resources: {'instances', 'cores', 'ram'} {{(pid=117563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 23:03:04.895397 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-2e91593b-c56c-46c1-814f-f1f19b3a6425 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Going to run 1 instances... {{(pid=117563) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 23:03:04.897725 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-2e91593b-c56c-46c1-814f-f1f19b3a6425 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] [instance: 22fa37ae-2cac-42ad-9332-ab7da7c574d5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2b486731-e5ea-4159-b6b1-ed0083e00543',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117563) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 23:03:04.950232 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-2e91593b-c56c-46c1-814f-f1f19b3a6425 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.801969 Jun 16 23:03:04.951228 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 180/356] 10.222.0.17 () {60 vars in 1146 bytes} [Thu Jun 16 23:03:04 2022] POST /compute/v2.1/servers => generated 402 bytes in 804 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 16 23:03:04.963296 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-9196232d-833b-457b-a3f0-e8bdaa327dd8 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:03:04.963946 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-9196232d-833b-457b-a3f0-e8bdaa327dd8 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] [instance: 22fa37ae-2cac-42ad-9332-ab7da7c574d5] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:03:05.023630 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-9196232d-833b-457b-a3f0-e8bdaa327dd8 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3a2d16133b4af8a208682de8a7d111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0526c12e8bc947209e24daf5ddfad7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:03:05.032643 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-9196232d-833b-457b-a3f0-e8bdaa327dd8 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] 10.222.0.17 "GET /compute/v2.1/servers/22fa37ae-2cac-42ad-9332-ab7da7c574d5" status: 200 len: 1241 microversion: 2.1 time: 0.075671 Jun 16 23:03:05.033216 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 177/357] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:03:04 2022] GET /compute/v2.1/servers/22fa37ae-2cac-42ad-9332-ab7da7c574d5 => generated 1241 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:03:05.402799 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-c0b12185-adc7-45c5-9f68-79d35e41d03f tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:03:05.403329 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-c0b12185-adc7-45c5-9f68-79d35e41d03f tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] [instance: 7e6c1a21-fd9c-4f9e-a23f-f2cacbdd2e7b] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:03:05.409657 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-c0b12185-adc7-45c5-9f68-79d35e41d03f tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:05.410108 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-c0b12185-adc7-45c5-9f68-79d35e41d03f tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:05.410969 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-c0b12185-adc7-45c5-9f68-79d35e41d03f tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:05.411418 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-c0b12185-adc7-45c5-9f68-79d35e41d03f tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:05.542413 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-c0b12185-adc7-45c5-9f68-79d35e41d03f tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69163c28aa75492aa01c70532bed15a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9761759a69724a21b0b9315a931b106f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:03:05.551239 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-c0b12185-adc7-45c5-9f68-79d35e41d03f tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] 10.222.0.17 "GET /compute/v2.1/servers/7e6c1a21-fd9c-4f9e-a23f-f2cacbdd2e7b" status: 200 len: 1319 microversion: 2.1 time: 0.152882 Jun 16 23:03:05.551808 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 181/358] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:03:05 2022] GET /compute/v2.1/servers/7e6c1a21-fd9c-4f9e-a23f-f2cacbdd2e7b => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:03:05.641540 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-543177b8-88e7-4c55-ab7a-8a8dbb518a95 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:03:05.642171 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-543177b8-88e7-4c55-ab7a-8a8dbb518a95 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 46f43909-d681-4938-8253-5080b626e169] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:03:05.650144 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-543177b8-88e7-4c55-ab7a-8a8dbb518a95 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:05.650846 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-543177b8-88e7-4c55-ab7a-8a8dbb518a95 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:05.651619 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-543177b8-88e7-4c55-ab7a-8a8dbb518a95 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:05.652239 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-543177b8-88e7-4c55-ab7a-8a8dbb518a95 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:05.822958 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-543177b8-88e7-4c55-ab7a-8a8dbb518a95 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:03:05.833141 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-543177b8-88e7-4c55-ab7a-8a8dbb518a95 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:03:05.835883 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-543177b8-88e7-4c55-ab7a-8a8dbb518a95 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:03:05.837422 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-543177b8-88e7-4c55-ab7a-8a8dbb518a95 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169" status: 200 len: 1723 microversion: 2.20 time: 0.199759 Jun 16 23:03:05.843100 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 178/359] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 23:03:05 2022] GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169 => generated 1723 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 23:03:05.878726 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-7d9874dc-2e2f-44dc-8dfc-c4bc8d07282f tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:03:05.879339 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-7d9874dc-2e2f-44dc-8dfc-c4bc8d07282f tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] [instance: f4c73822-1dfa-4eed-bf02-1123b0402755] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:03:05.887061 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-7d9874dc-2e2f-44dc-8dfc-c4bc8d07282f tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:05.887516 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-7d9874dc-2e2f-44dc-8dfc-c4bc8d07282f tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:05.888482 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-7d9874dc-2e2f-44dc-8dfc-c4bc8d07282f tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:05.888926 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-7d9874dc-2e2f-44dc-8dfc-c4bc8d07282f tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:06.045038 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-7d9874dc-2e2f-44dc-8dfc-c4bc8d07282f tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a993f5d14b64fccad723abecfcadf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b1be8431b0434d8bd6abca293127d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:03:06.049285 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-f08c2589-669a-4648-b98f-dd1e403e1cfd tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:03:06.050000 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-f08c2589-669a-4648-b98f-dd1e403e1cfd tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] [instance: 22fa37ae-2cac-42ad-9332-ab7da7c574d5] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:03:06.056828 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-7d9874dc-2e2f-44dc-8dfc-c4bc8d07282f tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] 10.222.0.17 "GET /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755" status: 200 len: 1723 microversion: 2.1 time: 0.183123 Jun 16 23:03:06.057066 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-f08c2589-669a-4648-b98f-dd1e403e1cfd tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:06.057695 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-f08c2589-669a-4648-b98f-dd1e403e1cfd tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:06.067318 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 182/360] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:03:05 2022] GET /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755 => generated 1723 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:03:06.067447 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-f08c2589-669a-4648-b98f-dd1e403e1cfd tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:06.067447 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-f08c2589-669a-4648-b98f-dd1e403e1cfd tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:06.121333 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-f08c2589-669a-4648-b98f-dd1e403e1cfd tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3a2d16133b4af8a208682de8a7d111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0526c12e8bc947209e24daf5ddfad7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:03:06.128710 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-f08c2589-669a-4648-b98f-dd1e403e1cfd tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] 10.222.0.17 "GET /compute/v2.1/servers/22fa37ae-2cac-42ad-9332-ab7da7c574d5" status: 200 len: 1293 microversion: 2.1 time: 0.083312 Jun 16 23:03:06.129263 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 179/361] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:03:06 2022] GET /compute/v2.1/servers/22fa37ae-2cac-42ad-9332-ab7da7c574d5 => generated 1293 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:03:06.569244 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-5b9f5fd3-3f40-482f-962d-20d5a0571c8b tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:03:06.570348 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-5b9f5fd3-3f40-482f-962d-20d5a0571c8b tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] [instance: 7e6c1a21-fd9c-4f9e-a23f-f2cacbdd2e7b] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:03:06.579744 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-5b9f5fd3-3f40-482f-962d-20d5a0571c8b tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:06.580203 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-5b9f5fd3-3f40-482f-962d-20d5a0571c8b tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:06.580997 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-5b9f5fd3-3f40-482f-962d-20d5a0571c8b tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:06.581439 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-5b9f5fd3-3f40-482f-962d-20d5a0571c8b tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:06.722353 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-5b9f5fd3-3f40-482f-962d-20d5a0571c8b tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69163c28aa75492aa01c70532bed15a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9761759a69724a21b0b9315a931b106f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:03:06.732762 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-5b9f5fd3-3f40-482f-962d-20d5a0571c8b tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] 10.222.0.17 "GET /compute/v2.1/servers/7e6c1a21-fd9c-4f9e-a23f-f2cacbdd2e7b" status: 200 len: 1319 microversion: 2.1 time: 0.167995 Jun 16 23:03:06.733428 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 183/362] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:03:06 2022] GET /compute/v2.1/servers/7e6c1a21-fd9c-4f9e-a23f-f2cacbdd2e7b => generated 1319 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:03:06.856801 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-2491e7d8-6cee-4db2-9918-57b2f46965f0 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:03:06.857413 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-2491e7d8-6cee-4db2-9918-57b2f46965f0 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 46f43909-d681-4938-8253-5080b626e169] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:03:06.864324 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-2491e7d8-6cee-4db2-9918-57b2f46965f0 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:06.864777 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-2491e7d8-6cee-4db2-9918-57b2f46965f0 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:06.865559 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-2491e7d8-6cee-4db2-9918-57b2f46965f0 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:06.865999 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-2491e7d8-6cee-4db2-9918-57b2f46965f0 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:07.011760 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-2491e7d8-6cee-4db2-9918-57b2f46965f0 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:03:07.020000 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-2491e7d8-6cee-4db2-9918-57b2f46965f0 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:03:07.022358 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-2491e7d8-6cee-4db2-9918-57b2f46965f0 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:03:07.023629 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-2491e7d8-6cee-4db2-9918-57b2f46965f0 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169" status: 200 len: 1723 microversion: 2.20 time: 0.170741 Jun 16 23:03:07.024272 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 180/363] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 23:03:06 2022] GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169 => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 23:03:07.074753 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-abfe499a-d485-4d42-b13b-d540445633c6 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:03:07.075359 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-abfe499a-d485-4d42-b13b-d540445633c6 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] [instance: f4c73822-1dfa-4eed-bf02-1123b0402755] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:03:07.082635 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-abfe499a-d485-4d42-b13b-d540445633c6 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:07.083055 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-abfe499a-d485-4d42-b13b-d540445633c6 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:07.083829 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-abfe499a-d485-4d42-b13b-d540445633c6 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:07.084262 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-abfe499a-d485-4d42-b13b-d540445633c6 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:07.147734 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-16a1764c-cd7c-44ef-9b1f-9e5707b2a924 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:03:07.148437 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-16a1764c-cd7c-44ef-9b1f-9e5707b2a924 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] [instance: 22fa37ae-2cac-42ad-9332-ab7da7c574d5] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:03:07.155449 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-16a1764c-cd7c-44ef-9b1f-9e5707b2a924 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:07.155988 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-16a1764c-cd7c-44ef-9b1f-9e5707b2a924 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:07.156975 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-16a1764c-cd7c-44ef-9b1f-9e5707b2a924 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:07.157708 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-16a1764c-cd7c-44ef-9b1f-9e5707b2a924 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:07.268412 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-abfe499a-d485-4d42-b13b-d540445633c6 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a993f5d14b64fccad723abecfcadf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b1be8431b0434d8bd6abca293127d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:03:07.271584 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-16a1764c-cd7c-44ef-9b1f-9e5707b2a924 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3a2d16133b4af8a208682de8a7d111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0526c12e8bc947209e24daf5ddfad7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:03:07.277708 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-abfe499a-d485-4d42-b13b-d540445633c6 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] 10.222.0.17 "GET /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755" status: 200 len: 1723 microversion: 2.1 time: 0.206640 Jun 16 23:03:07.278634 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 184/364] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:03:07 2022] GET /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755 => generated 1723 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:03:07.280452 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-16a1764c-cd7c-44ef-9b1f-9e5707b2a924 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] 10.222.0.17 "GET /compute/v2.1/servers/22fa37ae-2cac-42ad-9332-ab7da7c574d5" status: 200 len: 1299 microversion: 2.1 time: 0.138111 Jun 16 23:03:07.281169 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 181/365] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:03:07 2022] GET /compute/v2.1/servers/22fa37ae-2cac-42ad-9332-ab7da7c574d5 => generated 1299 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:03:07.749279 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-678190f2-53f1-42b7-aa53-5afff31058a8 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:03:07.749901 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-678190f2-53f1-42b7-aa53-5afff31058a8 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] [instance: 7e6c1a21-fd9c-4f9e-a23f-f2cacbdd2e7b] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:03:07.757440 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-678190f2-53f1-42b7-aa53-5afff31058a8 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:07.757891 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-678190f2-53f1-42b7-aa53-5afff31058a8 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:07.758697 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-678190f2-53f1-42b7-aa53-5afff31058a8 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:07.759144 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-678190f2-53f1-42b7-aa53-5afff31058a8 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:07.898086 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-678190f2-53f1-42b7-aa53-5afff31058a8 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69163c28aa75492aa01c70532bed15a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9761759a69724a21b0b9315a931b106f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:03:07.906191 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-678190f2-53f1-42b7-aa53-5afff31058a8 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] 10.222.0.17 "GET /compute/v2.1/servers/7e6c1a21-fd9c-4f9e-a23f-f2cacbdd2e7b" status: 200 len: 1319 microversion: 2.1 time: 0.160706 Jun 16 23:03:07.906803 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 185/366] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:03:07 2022] GET /compute/v2.1/servers/7e6c1a21-fd9c-4f9e-a23f-f2cacbdd2e7b => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:03:08.042790 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-8170d0d6-32ca-4445-a1ca-e7034f5309fa tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:03:08.043566 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-8170d0d6-32ca-4445-a1ca-e7034f5309fa tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 46f43909-d681-4938-8253-5080b626e169] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:03:08.052878 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-8170d0d6-32ca-4445-a1ca-e7034f5309fa tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:08.054048 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-8170d0d6-32ca-4445-a1ca-e7034f5309fa tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:08.055224 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-8170d0d6-32ca-4445-a1ca-e7034f5309fa tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:08.056787 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-8170d0d6-32ca-4445-a1ca-e7034f5309fa tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:08.063745 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG dbcounter [-] [117562] Writing DB stats nova_cell1:SELECT=100 {{(pid=117562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 23:03:08.222120 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-8170d0d6-32ca-4445-a1ca-e7034f5309fa tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:03:08.248988 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-8170d0d6-32ca-4445-a1ca-e7034f5309fa tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:03:08.252204 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-8170d0d6-32ca-4445-a1ca-e7034f5309fa tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:03:08.254375 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-8170d0d6-32ca-4445-a1ca-e7034f5309fa tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169" status: 200 len: 1723 microversion: 2.20 time: 0.216825 Jun 16 23:03:08.272443 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 182/367] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 23:03:08 2022] GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169 => generated 1723 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 23:03:08.298584 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-0bbb18e3-d8e9-4e45-87e0-c6e799990177 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:03:08.299446 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-0bbb18e3-d8e9-4e45-87e0-c6e799990177 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] [instance: f4c73822-1dfa-4eed-bf02-1123b0402755] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:03:08.308198 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-0bbb18e3-d8e9-4e45-87e0-c6e799990177 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:08.309054 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-0bbb18e3-d8e9-4e45-87e0-c6e799990177 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:08.310216 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-0bbb18e3-d8e9-4e45-87e0-c6e799990177 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:08.311089 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-0bbb18e3-d8e9-4e45-87e0-c6e799990177 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:08.314192 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-395610fc-146c-46bf-985a-4f1fd1177040 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:03:08.314984 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-395610fc-146c-46bf-985a-4f1fd1177040 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] [instance: 22fa37ae-2cac-42ad-9332-ab7da7c574d5] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:03:08.359185 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-395610fc-146c-46bf-985a-4f1fd1177040 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:08.359987 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-395610fc-146c-46bf-985a-4f1fd1177040 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:08.360814 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-395610fc-146c-46bf-985a-4f1fd1177040 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:08.361263 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-395610fc-146c-46bf-985a-4f1fd1177040 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:08.577795 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-0bbb18e3-d8e9-4e45-87e0-c6e799990177 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a993f5d14b64fccad723abecfcadf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b1be8431b0434d8bd6abca293127d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:03:08.591286 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-395610fc-146c-46bf-985a-4f1fd1177040 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3a2d16133b4af8a208682de8a7d111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0526c12e8bc947209e24daf5ddfad7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:03:08.592708 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-0bbb18e3-d8e9-4e45-87e0-c6e799990177 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] 10.222.0.17 "GET /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755" status: 200 len: 1723 microversion: 2.1 time: 0.301067 Jun 16 23:03:08.600211 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-395610fc-146c-46bf-985a-4f1fd1177040 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] 10.222.0.17 "GET /compute/v2.1/servers/22fa37ae-2cac-42ad-9332-ab7da7c574d5" status: 200 len: 1367 microversion: 2.1 time: 0.301626 Jun 16 23:03:08.601174 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 183/368] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:03:08 2022] GET /compute/v2.1/servers/22fa37ae-2cac-42ad-9332-ab7da7c574d5 => generated 1367 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:03:08.606645 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [req-2fbcecf2-9400-4928-9654-ffb2116a35e2 req-6a8d6fec-63bd-400b-9f84-5fa945c69580 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22fa37ae-2cac-42ad-9332-ab7da7c574d5", "tag": "e50a352e-8b05-48d5-9a0b-3df6a0efc12b"}]} {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 23:03:08.614047 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 186/369] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:03:08 2022] GET /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755 => generated 1723 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:03:08.616121 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [req-2fbcecf2-9400-4928-9654-ffb2116a35e2 req-6a8d6fec-63bd-400b-9f84-5fa945c69580 service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:08.616580 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [req-2fbcecf2-9400-4928-9654-ffb2116a35e2 req-6a8d6fec-63bd-400b-9f84-5fa945c69580 service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:08.629716 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.compute.server_external_events [req-2fbcecf2-9400-4928-9654-ffb2116a35e2 req-6a8d6fec-63bd-400b-9f84-5fa945c69580 service nova] Creating event network-changed:e50a352e-8b05-48d5-9a0b-3df6a0efc12b for instance 22fa37ae-2cac-42ad-9332-ab7da7c574d5 on hv-cinder-84623 Jun 16 23:03:08.635305 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [req-2fbcecf2-9400-4928-9654-ffb2116a35e2 req-6a8d6fec-63bd-400b-9f84-5fa945c69580 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033090 Jun 16 23:03:08.635936 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 184/370] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 23:03:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 23:03:08.924393 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-6dd85f73-30c9-426c-a2a2-7af6b248a653 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:03:08.925120 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-6dd85f73-30c9-426c-a2a2-7af6b248a653 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] [instance: 7e6c1a21-fd9c-4f9e-a23f-f2cacbdd2e7b] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:03:08.932131 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG dbcounter [-] [117563] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=117563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 23:03:08.934443 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-6dd85f73-30c9-426c-a2a2-7af6b248a653 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:08.935209 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-6dd85f73-30c9-426c-a2a2-7af6b248a653 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:08.936197 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-6dd85f73-30c9-426c-a2a2-7af6b248a653 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:08.936798 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-6dd85f73-30c9-426c-a2a2-7af6b248a653 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:09.144553 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-6dd85f73-30c9-426c-a2a2-7af6b248a653 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69163c28aa75492aa01c70532bed15a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9761759a69724a21b0b9315a931b106f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:03:09.151979 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-6dd85f73-30c9-426c-a2a2-7af6b248a653 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] 10.222.0.17 "GET /compute/v2.1/servers/7e6c1a21-fd9c-4f9e-a23f-f2cacbdd2e7b" status: 200 len: 1319 microversion: 2.1 time: 0.233015 Jun 16 23:03:09.152547 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 187/371] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:03:08 2022] GET /compute/v2.1/servers/7e6c1a21-fd9c-4f9e-a23f-f2cacbdd2e7b => generated 1319 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:03:09.275291 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-2e617ca1-6c70-41e3-821e-9e3cc52b6411 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:03:09.275996 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-2e617ca1-6c70-41e3-821e-9e3cc52b6411 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 46f43909-d681-4938-8253-5080b626e169] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:03:09.282373 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-2e617ca1-6c70-41e3-821e-9e3cc52b6411 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:09.282859 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-2e617ca1-6c70-41e3-821e-9e3cc52b6411 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:09.283899 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-2e617ca1-6c70-41e3-821e-9e3cc52b6411 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:09.284342 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-2e617ca1-6c70-41e3-821e-9e3cc52b6411 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:09.456417 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-2e617ca1-6c70-41e3-821e-9e3cc52b6411 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:03:09.466108 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-2e617ca1-6c70-41e3-821e-9e3cc52b6411 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:03:09.468213 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-2e617ca1-6c70-41e3-821e-9e3cc52b6411 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:03:09.469505 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-2e617ca1-6c70-41e3-821e-9e3cc52b6411 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169" status: 200 len: 1723 microversion: 2.20 time: 0.199999 Jun 16 23:03:09.471112 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 185/372] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 23:03:09 2022] GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169 => generated 1723 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 23:03:09.617480 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-f9b1889e-ea96-4170-b5e9-c46685965797 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:03:09.617797 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-1013e718-8293-4da4-9853-4ba6bad84fbd tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:03:09.618097 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-f9b1889e-ea96-4170-b5e9-c46685965797 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] [instance: f4c73822-1dfa-4eed-bf02-1123b0402755] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:03:09.618291 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-1013e718-8293-4da4-9853-4ba6bad84fbd tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] [instance: 22fa37ae-2cac-42ad-9332-ab7da7c574d5] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:03:09.624226 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-f9b1889e-ea96-4170-b5e9-c46685965797 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:09.624369 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-1013e718-8293-4da4-9853-4ba6bad84fbd tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:09.624673 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-f9b1889e-ea96-4170-b5e9-c46685965797 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:09.624774 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-1013e718-8293-4da4-9853-4ba6bad84fbd tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:09.625437 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-f9b1889e-ea96-4170-b5e9-c46685965797 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:09.625535 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-1013e718-8293-4da4-9853-4ba6bad84fbd tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:09.625870 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-f9b1889e-ea96-4170-b5e9-c46685965797 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:09.625977 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-1013e718-8293-4da4-9853-4ba6bad84fbd tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:09.814765 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-1013e718-8293-4da4-9853-4ba6bad84fbd tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3a2d16133b4af8a208682de8a7d111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0526c12e8bc947209e24daf5ddfad7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:03:09.822875 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-f9b1889e-ea96-4170-b5e9-c46685965797 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a993f5d14b64fccad723abecfcadf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b1be8431b0434d8bd6abca293127d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:03:09.823108 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-1013e718-8293-4da4-9853-4ba6bad84fbd tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] 10.222.0.17 "GET /compute/v2.1/servers/22fa37ae-2cac-42ad-9332-ab7da7c574d5" status: 200 len: 1367 microversion: 2.1 time: 0.209912 Jun 16 23:03:09.823693 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 188/373] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:03:09 2022] GET /compute/v2.1/servers/22fa37ae-2cac-42ad-9332-ab7da7c574d5 => generated 1367 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 23:03:09.831095 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-f9b1889e-ea96-4170-b5e9-c46685965797 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] 10.222.0.17 "GET /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755" status: 200 len: 1723 microversion: 2.1 time: 0.217919 Jun 16 23:03:09.831656 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 186/374] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:03:09 2022] GET /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755 => generated 1723 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:03:10.169245 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-f756948b-e22e-48ce-afaf-652ea117dc97 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:03:10.169858 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-f756948b-e22e-48ce-afaf-652ea117dc97 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] [instance: 7e6c1a21-fd9c-4f9e-a23f-f2cacbdd2e7b] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:03:10.176311 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-f756948b-e22e-48ce-afaf-652ea117dc97 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:10.177264 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-f756948b-e22e-48ce-afaf-652ea117dc97 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:10.178041 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-f756948b-e22e-48ce-afaf-652ea117dc97 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:10.178480 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-f756948b-e22e-48ce-afaf-652ea117dc97 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:10.311410 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-f756948b-e22e-48ce-afaf-652ea117dc97 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69163c28aa75492aa01c70532bed15a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9761759a69724a21b0b9315a931b106f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:03:10.320080 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-f756948b-e22e-48ce-afaf-652ea117dc97 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] 10.222.0.17 "GET /compute/v2.1/servers/7e6c1a21-fd9c-4f9e-a23f-f2cacbdd2e7b" status: 200 len: 1319 microversion: 2.1 time: 0.154731 Jun 16 23:03:10.320650 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 189/375] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:03:10 2022] GET /compute/v2.1/servers/7e6c1a21-fd9c-4f9e-a23f-f2cacbdd2e7b => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:03:10.488558 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-64b6a124-7898-43be-a5d8-b367b7918145 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:03:10.489809 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-64b6a124-7898-43be-a5d8-b367b7918145 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 46f43909-d681-4938-8253-5080b626e169] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:03:10.496404 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-64b6a124-7898-43be-a5d8-b367b7918145 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:10.496852 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-64b6a124-7898-43be-a5d8-b367b7918145 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:10.497629 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-64b6a124-7898-43be-a5d8-b367b7918145 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:10.498070 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-64b6a124-7898-43be-a5d8-b367b7918145 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:10.628534 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-64b6a124-7898-43be-a5d8-b367b7918145 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:03:10.636945 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-64b6a124-7898-43be-a5d8-b367b7918145 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:03:10.638485 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-64b6a124-7898-43be-a5d8-b367b7918145 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:03:10.639678 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-64b6a124-7898-43be-a5d8-b367b7918145 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169" status: 200 len: 1723 microversion: 2.20 time: 0.155017 Jun 16 23:03:10.640275 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 187/376] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 23:03:10 2022] GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 23:03:10.840166 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-78f522b2-3e2c-4037-af45-61997841cedb tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:03:10.840787 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-78f522b2-3e2c-4037-af45-61997841cedb tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] [instance: 22fa37ae-2cac-42ad-9332-ab7da7c574d5] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:03:10.847852 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-78f522b2-3e2c-4037-af45-61997841cedb tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:10.848800 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-78f522b2-3e2c-4037-af45-61997841cedb tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:10.849610 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-78f522b2-3e2c-4037-af45-61997841cedb tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:10.849853 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-de86eddc-667a-4a1f-a298-ae506c160b2a tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:03:10.850055 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-78f522b2-3e2c-4037-af45-61997841cedb tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:10.850582 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-de86eddc-667a-4a1f-a298-ae506c160b2a tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] [instance: f4c73822-1dfa-4eed-bf02-1123b0402755] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:03:10.857005 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-de86eddc-667a-4a1f-a298-ae506c160b2a tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:10.857529 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-de86eddc-667a-4a1f-a298-ae506c160b2a tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:10.858365 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-de86eddc-667a-4a1f-a298-ae506c160b2a tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:10.858964 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-de86eddc-667a-4a1f-a298-ae506c160b2a tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:11.054602 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-78f522b2-3e2c-4037-af45-61997841cedb tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3a2d16133b4af8a208682de8a7d111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0526c12e8bc947209e24daf5ddfad7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:03:11.060917 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-de86eddc-667a-4a1f-a298-ae506c160b2a tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a993f5d14b64fccad723abecfcadf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b1be8431b0434d8bd6abca293127d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:03:11.063050 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-78f522b2-3e2c-4037-af45-61997841cedb tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] 10.222.0.17 "GET /compute/v2.1/servers/22fa37ae-2cac-42ad-9332-ab7da7c574d5" status: 200 len: 1367 microversion: 2.1 time: 0.226963 Jun 16 23:03:11.063626 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 190/377] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:03:10 2022] GET /compute/v2.1/servers/22fa37ae-2cac-42ad-9332-ab7da7c574d5 => generated 1367 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:03:11.076077 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [req-4086d417-670e-4138-ad05-d0fc59ce83b8 req-4845ffc4-d77d-4b17-a7ad-c7543a522025 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e6c1a21-fd9c-4f9e-a23f-f2cacbdd2e7b", "name": "network-vif-plugged", "status": "completed", "tag": "9f27a5db-37c7-4f56-a95a-f2cd921a04db"}]} {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 23:03:11.079210 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-de86eddc-667a-4a1f-a298-ae506c160b2a tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] 10.222.0.17 "GET /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755" status: 200 len: 1700 microversion: 2.1 time: 0.233935 Jun 16 23:03:11.079992 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 188/378] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:03:10 2022] GET /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755 => generated 1700 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 23:03:11.085191 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-4086d417-670e-4138-ad05-d0fc59ce83b8 req-4845ffc4-d77d-4b17-a7ad-c7543a522025 service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:11.085640 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-4086d417-670e-4138-ad05-d0fc59ce83b8 req-4845ffc4-d77d-4b17-a7ad-c7543a522025 service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:11.089485 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG dbcounter [-] [117563] Writing DB stats nova_cell1:SELECT=100 {{(pid=117563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 23:03:11.096626 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-30eee18e-d05c-406a-aa54-19ec3bc10c0e tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 23:03:11.097795 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.compute.server_external_events [req-4086d417-670e-4138-ad05-d0fc59ce83b8 req-4845ffc4-d77d-4b17-a7ad-c7543a522025 service nova] Creating event network-vif-plugged:9f27a5db-37c7-4f56-a95a-f2cd921a04db for instance 7e6c1a21-fd9c-4f9e-a23f-f2cacbdd2e7b on hv-cinder-84623 Jun 16 23:03:11.103277 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [req-4086d417-670e-4138-ad05-d0fc59ce83b8 req-4845ffc4-d77d-4b17-a7ad-c7543a522025 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038538 Jun 16 23:03:11.104185 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-30eee18e-d05c-406a-aa54-19ec3bc10c0e tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:11.104309 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 191/379] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 23:03:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 23:03:11.104759 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-30eee18e-d05c-406a-aa54-19ec3bc10c0e tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:11.129557 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-30eee18e-d05c-406a-aa54-19ec3bc10c0e tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] [instance: f4c73822-1dfa-4eed-bf02-1123b0402755] Going to try to start instance {{(pid=117562) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 16 23:03:11.174063 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-30eee18e-d05c-406a-aa54-19ec3bc10c0e tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] 10.222.0.17 "POST /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755/action" status: 202 len: 0 microversion: 2.1 time: 0.081261 Jun 16 23:03:11.174970 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 189/380] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Jun 16 23:03:11 2022] POST /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 16 23:03:11.184489 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-9ef9c3b4-e143-49ad-86c2-662b8bdb9fd6 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:03:11.186068 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-9ef9c3b4-e143-49ad-86c2-662b8bdb9fd6 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] [instance: f4c73822-1dfa-4eed-bf02-1123b0402755] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:03:11.193699 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-9ef9c3b4-e143-49ad-86c2-662b8bdb9fd6 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:11.194351 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-9ef9c3b4-e143-49ad-86c2-662b8bdb9fd6 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:11.195369 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-9ef9c3b4-e143-49ad-86c2-662b8bdb9fd6 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:11.195833 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-9ef9c3b4-e143-49ad-86c2-662b8bdb9fd6 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:11.338050 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-4031cff1-d4c7-4893-a3a5-088857eabe99 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:03:11.338780 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-4031cff1-d4c7-4893-a3a5-088857eabe99 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] [instance: 7e6c1a21-fd9c-4f9e-a23f-f2cacbdd2e7b] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:03:11.344938 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-4031cff1-d4c7-4893-a3a5-088857eabe99 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:11.345393 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-4031cff1-d4c7-4893-a3a5-088857eabe99 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:11.346163 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-4031cff1-d4c7-4893-a3a5-088857eabe99 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:11.346646 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-4031cff1-d4c7-4893-a3a5-088857eabe99 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:11.352776 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-9ef9c3b4-e143-49ad-86c2-662b8bdb9fd6 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a993f5d14b64fccad723abecfcadf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b1be8431b0434d8bd6abca293127d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:03:11.361001 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-9ef9c3b4-e143-49ad-86c2-662b8bdb9fd6 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] 10.222.0.17 "GET /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755" status: 200 len: 1709 microversion: 2.1 time: 0.181200 Jun 16 23:03:11.361570 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 192/381] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:03:11 2022] GET /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755 => generated 1709 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:03:11.491289 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-4031cff1-d4c7-4893-a3a5-088857eabe99 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69163c28aa75492aa01c70532bed15a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9761759a69724a21b0b9315a931b106f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:03:11.499393 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-4031cff1-d4c7-4893-a3a5-088857eabe99 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] 10.222.0.17 "GET /compute/v2.1/servers/7e6c1a21-fd9c-4f9e-a23f-f2cacbdd2e7b" status: 200 len: 1319 microversion: 2.1 time: 0.165459 Jun 16 23:03:11.500287 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 190/382] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:03:11 2022] GET /compute/v2.1/servers/7e6c1a21-fd9c-4f9e-a23f-f2cacbdd2e7b => generated 1319 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:03:11.657272 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-e4b2ff7e-96bc-449a-baf6-0721551e48d0 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:03:11.657881 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-e4b2ff7e-96bc-449a-baf6-0721551e48d0 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 46f43909-d681-4938-8253-5080b626e169] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:03:11.664507 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-e4b2ff7e-96bc-449a-baf6-0721551e48d0 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:11.664965 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-e4b2ff7e-96bc-449a-baf6-0721551e48d0 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:11.665728 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-e4b2ff7e-96bc-449a-baf6-0721551e48d0 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:11.666164 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-e4b2ff7e-96bc-449a-baf6-0721551e48d0 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:11.802539 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-e4b2ff7e-96bc-449a-baf6-0721551e48d0 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:03:11.811157 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-e4b2ff7e-96bc-449a-baf6-0721551e48d0 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:03:11.812595 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-e4b2ff7e-96bc-449a-baf6-0721551e48d0 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:03:11.813753 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-e4b2ff7e-96bc-449a-baf6-0721551e48d0 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169" status: 200 len: 1744 microversion: 2.20 time: 0.160477 Jun 16 23:03:11.814304 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 193/383] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 23:03:11 2022] GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169 => generated 1744 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 23:03:12.079981 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-d780b534-8e20-4314-ade1-ebdf5f2dc920 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:03:12.080505 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-d780b534-8e20-4314-ade1-ebdf5f2dc920 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] [instance: 22fa37ae-2cac-42ad-9332-ab7da7c574d5] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:03:12.086567 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-d780b534-8e20-4314-ade1-ebdf5f2dc920 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:12.087044 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-d780b534-8e20-4314-ade1-ebdf5f2dc920 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:12.087800 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-d780b534-8e20-4314-ade1-ebdf5f2dc920 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:12.088235 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-d780b534-8e20-4314-ade1-ebdf5f2dc920 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:12.222471 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-d780b534-8e20-4314-ade1-ebdf5f2dc920 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3a2d16133b4af8a208682de8a7d111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0526c12e8bc947209e24daf5ddfad7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:03:12.230327 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-d780b534-8e20-4314-ade1-ebdf5f2dc920 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] 10.222.0.17 "GET /compute/v2.1/servers/22fa37ae-2cac-42ad-9332-ab7da7c574d5" status: 200 len: 1367 microversion: 2.1 time: 0.154315 Jun 16 23:03:12.230937 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 191/384] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:03:12 2022] GET /compute/v2.1/servers/22fa37ae-2cac-42ad-9332-ab7da7c574d5 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:03:12.378615 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-948a4803-fd48-45fd-9a68-b63c1641c540 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:03:12.379229 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-948a4803-fd48-45fd-9a68-b63c1641c540 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] [instance: f4c73822-1dfa-4eed-bf02-1123b0402755] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:03:12.385609 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-948a4803-fd48-45fd-9a68-b63c1641c540 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:12.386051 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-948a4803-fd48-45fd-9a68-b63c1641c540 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:12.386835 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-948a4803-fd48-45fd-9a68-b63c1641c540 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:12.387269 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-948a4803-fd48-45fd-9a68-b63c1641c540 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:12.515746 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-6f863a91-2e3b-4c06-bcb3-f443db10582a tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:03:12.516887 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-6f863a91-2e3b-4c06-bcb3-f443db10582a tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] [instance: 7e6c1a21-fd9c-4f9e-a23f-f2cacbdd2e7b] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:03:12.517152 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-948a4803-fd48-45fd-9a68-b63c1641c540 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a993f5d14b64fccad723abecfcadf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b1be8431b0434d8bd6abca293127d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:03:12.524193 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-6f863a91-2e3b-4c06-bcb3-f443db10582a tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:12.525848 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-948a4803-fd48-45fd-9a68-b63c1641c540 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] 10.222.0.17 "GET /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755" status: 200 len: 1709 microversion: 2.1 time: 0.151064 Jun 16 23:03:12.526420 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 194/385] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:03:12 2022] GET /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755 => generated 1709 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:03:12.528281 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-6f863a91-2e3b-4c06-bcb3-f443db10582a tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:12.529475 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-6f863a91-2e3b-4c06-bcb3-f443db10582a tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:12.529928 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-6f863a91-2e3b-4c06-bcb3-f443db10582a tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:12.660672 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-6f863a91-2e3b-4c06-bcb3-f443db10582a tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69163c28aa75492aa01c70532bed15a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9761759a69724a21b0b9315a931b106f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:03:12.668305 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-6f863a91-2e3b-4c06-bcb3-f443db10582a tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] 10.222.0.17 "GET /compute/v2.1/servers/7e6c1a21-fd9c-4f9e-a23f-f2cacbdd2e7b" status: 200 len: 1319 microversion: 2.1 time: 0.156545 Jun 16 23:03:12.668875 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 192/386] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:03:12 2022] GET /compute/v2.1/servers/7e6c1a21-fd9c-4f9e-a23f-f2cacbdd2e7b => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:03:12.833428 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-477fc9fc-7a54-4f25-94f0-ca84bf29f186 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:03:12.834345 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-477fc9fc-7a54-4f25-94f0-ca84bf29f186 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 46f43909-d681-4938-8253-5080b626e169] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:03:12.840380 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-477fc9fc-7a54-4f25-94f0-ca84bf29f186 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:12.840841 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-477fc9fc-7a54-4f25-94f0-ca84bf29f186 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:12.841627 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-477fc9fc-7a54-4f25-94f0-ca84bf29f186 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:12.842069 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-477fc9fc-7a54-4f25-94f0-ca84bf29f186 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:12.974207 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-477fc9fc-7a54-4f25-94f0-ca84bf29f186 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:03:12.982147 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-477fc9fc-7a54-4f25-94f0-ca84bf29f186 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:03:12.983725 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-477fc9fc-7a54-4f25-94f0-ca84bf29f186 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:03:12.985048 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-477fc9fc-7a54-4f25-94f0-ca84bf29f186 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169" status: 200 len: 1744 microversion: 2.20 time: 0.156033 Jun 16 23:03:12.985556 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 195/387] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 23:03:12 2022] GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169 => generated 1744 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 23:03:13.247897 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-9115672f-dac1-4418-817c-e0c528b6572b tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:03:13.248610 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-9115672f-dac1-4418-817c-e0c528b6572b tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] [instance: 22fa37ae-2cac-42ad-9332-ab7da7c574d5] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:03:13.255673 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-9115672f-dac1-4418-817c-e0c528b6572b tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:13.256130 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-9115672f-dac1-4418-817c-e0c528b6572b tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:13.256901 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-9115672f-dac1-4418-817c-e0c528b6572b tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:13.257343 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-9115672f-dac1-4418-817c-e0c528b6572b tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:13.391609 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-9115672f-dac1-4418-817c-e0c528b6572b tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3a2d16133b4af8a208682de8a7d111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0526c12e8bc947209e24daf5ddfad7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:03:13.399632 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-9115672f-dac1-4418-817c-e0c528b6572b tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] 10.222.0.17 "GET /compute/v2.1/servers/22fa37ae-2cac-42ad-9332-ab7da7c574d5" status: 200 len: 1367 microversion: 2.1 time: 0.155730 Jun 16 23:03:13.400188 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 193/388] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:03:13 2022] GET /compute/v2.1/servers/22fa37ae-2cac-42ad-9332-ab7da7c574d5 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 23:03:13.543958 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-bae312cf-f1d6-48c4-8ba2-71ae7ba369ee tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:03:13.544588 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-bae312cf-f1d6-48c4-8ba2-71ae7ba369ee tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] [instance: f4c73822-1dfa-4eed-bf02-1123b0402755] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:03:13.550938 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-bae312cf-f1d6-48c4-8ba2-71ae7ba369ee tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:13.551389 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-bae312cf-f1d6-48c4-8ba2-71ae7ba369ee tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:13.552151 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-bae312cf-f1d6-48c4-8ba2-71ae7ba369ee tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:13.552581 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-bae312cf-f1d6-48c4-8ba2-71ae7ba369ee tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:13.681309 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-bae312cf-f1d6-48c4-8ba2-71ae7ba369ee tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a993f5d14b64fccad723abecfcadf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b1be8431b0434d8bd6abca293127d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:03:13.685002 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-3c8cbbcc-cc31-45bd-bef9-2f1dfcbfe744 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:03:13.685608 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-3c8cbbcc-cc31-45bd-bef9-2f1dfcbfe744 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] [instance: 7e6c1a21-fd9c-4f9e-a23f-f2cacbdd2e7b] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:03:13.689307 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-bae312cf-f1d6-48c4-8ba2-71ae7ba369ee tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] 10.222.0.17 "GET /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755" status: 200 len: 1709 microversion: 2.1 time: 0.149143 Jun 16 23:03:13.689873 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 196/389] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:03:13 2022] GET /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755 => generated 1709 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:03:13.692782 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-3c8cbbcc-cc31-45bd-bef9-2f1dfcbfe744 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:13.693230 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-3c8cbbcc-cc31-45bd-bef9-2f1dfcbfe744 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:13.693998 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-3c8cbbcc-cc31-45bd-bef9-2f1dfcbfe744 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:13.694435 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-3c8cbbcc-cc31-45bd-bef9-2f1dfcbfe744 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:13.830010 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-3c8cbbcc-cc31-45bd-bef9-2f1dfcbfe744 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69163c28aa75492aa01c70532bed15a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9761759a69724a21b0b9315a931b106f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:03:13.837755 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-3c8cbbcc-cc31-45bd-bef9-2f1dfcbfe744 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] 10.222.0.17 "GET /compute/v2.1/servers/7e6c1a21-fd9c-4f9e-a23f-f2cacbdd2e7b" status: 200 len: 1509 microversion: 2.1 time: 0.156437 Jun 16 23:03:13.838412 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 194/390] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:03:13 2022] GET /compute/v2.1/servers/7e6c1a21-fd9c-4f9e-a23f-f2cacbdd2e7b => generated 1509 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 23:03:14.003577 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-92f19ad1-18e7-47e6-914a-5607d6006313 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:03:14.004251 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-92f19ad1-18e7-47e6-914a-5607d6006313 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 46f43909-d681-4938-8253-5080b626e169] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:03:14.010888 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-92f19ad1-18e7-47e6-914a-5607d6006313 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:14.011336 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-92f19ad1-18e7-47e6-914a-5607d6006313 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:14.012093 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-92f19ad1-18e7-47e6-914a-5607d6006313 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:14.012527 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-92f19ad1-18e7-47e6-914a-5607d6006313 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:14.149443 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-92f19ad1-18e7-47e6-914a-5607d6006313 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:03:14.157406 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-92f19ad1-18e7-47e6-914a-5607d6006313 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:03:14.158970 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-92f19ad1-18e7-47e6-914a-5607d6006313 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:03:14.160188 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-92f19ad1-18e7-47e6-914a-5607d6006313 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169" status: 200 len: 1744 microversion: 2.20 time: 0.160524 Jun 16 23:03:14.161288 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 197/391] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 23:03:13 2022] GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169 => generated 1744 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 23:03:14.416694 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-00bcc84b-492c-4ad3-848f-12bf51d30810 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:03:14.417304 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-00bcc84b-492c-4ad3-848f-12bf51d30810 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] [instance: 22fa37ae-2cac-42ad-9332-ab7da7c574d5] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:03:14.423917 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-00bcc84b-492c-4ad3-848f-12bf51d30810 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:14.424368 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-00bcc84b-492c-4ad3-848f-12bf51d30810 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:14.425133 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-00bcc84b-492c-4ad3-848f-12bf51d30810 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:14.425574 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-00bcc84b-492c-4ad3-848f-12bf51d30810 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:14.554616 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-00bcc84b-492c-4ad3-848f-12bf51d30810 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3a2d16133b4af8a208682de8a7d111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0526c12e8bc947209e24daf5ddfad7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:03:14.562378 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-00bcc84b-492c-4ad3-848f-12bf51d30810 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] 10.222.0.17 "GET /compute/v2.1/servers/22fa37ae-2cac-42ad-9332-ab7da7c574d5" status: 200 len: 1367 microversion: 2.1 time: 0.149539 Jun 16 23:03:14.563696 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 195/392] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:03:14 2022] GET /compute/v2.1/servers/22fa37ae-2cac-42ad-9332-ab7da7c574d5 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:03:14.707231 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-50ab0cad-71cb-4ce4-b02f-a244760ebcdd tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:03:14.707835 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-50ab0cad-71cb-4ce4-b02f-a244760ebcdd tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] [instance: f4c73822-1dfa-4eed-bf02-1123b0402755] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:03:14.714581 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-50ab0cad-71cb-4ce4-b02f-a244760ebcdd tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:14.715086 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-50ab0cad-71cb-4ce4-b02f-a244760ebcdd tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:14.715840 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-50ab0cad-71cb-4ce4-b02f-a244760ebcdd tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:14.716273 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-50ab0cad-71cb-4ce4-b02f-a244760ebcdd tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:14.853259 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-50ab0cad-71cb-4ce4-b02f-a244760ebcdd tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a993f5d14b64fccad723abecfcadf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b1be8431b0434d8bd6abca293127d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:03:14.862679 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-50ab0cad-71cb-4ce4-b02f-a244760ebcdd tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] 10.222.0.17 "GET /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755" status: 200 len: 1713 microversion: 2.1 time: 0.159478 Jun 16 23:03:14.864032 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 198/393] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:03:14 2022] GET /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755 => generated 1713 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:03:15.119250 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [req-99838765-57f5-4886-a1b3-a967fffea508 req-f1313ff2-f08b-4b21-b9bf-2e547fc389ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22fa37ae-2cac-42ad-9332-ab7da7c574d5", "name": "network-vif-plugged", "status": "completed", "tag": "e50a352e-8b05-48d5-9a0b-3df6a0efc12b"}]} {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 23:03:15.124102 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG dbcounter [-] [117562] Writing DB stats nova_cell0:SELECT=6 {{(pid=117562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 23:03:15.136292 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [req-99838765-57f5-4886-a1b3-a967fffea508 req-f1313ff2-f08b-4b21-b9bf-2e547fc389ea service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:15.136891 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [req-99838765-57f5-4886-a1b3-a967fffea508 req-f1313ff2-f08b-4b21-b9bf-2e547fc389ea service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:15.152212 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.compute.server_external_events [req-99838765-57f5-4886-a1b3-a967fffea508 req-f1313ff2-f08b-4b21-b9bf-2e547fc389ea service nova] Creating event network-vif-plugged:e50a352e-8b05-48d5-9a0b-3df6a0efc12b for instance 22fa37ae-2cac-42ad-9332-ab7da7c574d5 on hv-cinder-84623 Jun 16 23:03:15.158582 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [req-99838765-57f5-4886-a1b3-a967fffea508 req-f1313ff2-f08b-4b21-b9bf-2e547fc389ea service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044929 Jun 16 23:03:15.159924 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 196/394] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 23:03:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 23:03:15.184832 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-3e79a0ba-334a-4f36-ad39-adf45276938b tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:03:15.185970 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-3e79a0ba-334a-4f36-ad39-adf45276938b tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 46f43909-d681-4938-8253-5080b626e169] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:03:15.191000 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG dbcounter [-] [117563] Writing DB stats nova_cell0:SELECT=4 {{(pid=117563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 23:03:15.192385 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG dbcounter [-] [117563] Writing DB stats nova_cell0:SELECT=14 {{(pid=117563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 23:03:15.205445 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-3e79a0ba-334a-4f36-ad39-adf45276938b tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:15.206897 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-3e79a0ba-334a-4f36-ad39-adf45276938b tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:15.207978 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-3e79a0ba-334a-4f36-ad39-adf45276938b tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:15.208774 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-3e79a0ba-334a-4f36-ad39-adf45276938b tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:15.436298 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-3e79a0ba-334a-4f36-ad39-adf45276938b tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:03:15.446012 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-3e79a0ba-334a-4f36-ad39-adf45276938b tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:03:15.448471 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-3e79a0ba-334a-4f36-ad39-adf45276938b tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:03:15.449815 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-3e79a0ba-334a-4f36-ad39-adf45276938b tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169" status: 200 len: 1739 microversion: 2.20 time: 0.273644 Jun 16 23:03:15.462049 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 199/395] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 23:03:15 2022] GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169 => generated 1739 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 23:03:15.587272 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-6bc76998-bbf6-49b4-adc3-8644e6f1c3f5 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:03:15.588359 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-6bc76998-bbf6-49b4-adc3-8644e6f1c3f5 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] [instance: 22fa37ae-2cac-42ad-9332-ab7da7c574d5] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:03:15.595038 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-6bc76998-bbf6-49b4-adc3-8644e6f1c3f5 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:15.595597 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-6bc76998-bbf6-49b4-adc3-8644e6f1c3f5 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:15.596953 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-6bc76998-bbf6-49b4-adc3-8644e6f1c3f5 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:15.597593 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-6bc76998-bbf6-49b4-adc3-8644e6f1c3f5 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:15.769110 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-6bc76998-bbf6-49b4-adc3-8644e6f1c3f5 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3a2d16133b4af8a208682de8a7d111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0526c12e8bc947209e24daf5ddfad7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:03:15.781633 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-6bc76998-bbf6-49b4-adc3-8644e6f1c3f5 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] 10.222.0.17 "GET /compute/v2.1/servers/22fa37ae-2cac-42ad-9332-ab7da7c574d5" status: 200 len: 1367 microversion: 2.1 time: 0.199795 Jun 16 23:03:15.782383 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 197/396] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:03:15 2022] GET /compute/v2.1/servers/22fa37ae-2cac-42ad-9332-ab7da7c574d5 => generated 1367 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:03:16.468918 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-5f8c3178-b571-4ff4-851a-95ca73a2c438 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:03:16.471240 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-5f8c3178-b571-4ff4-851a-95ca73a2c438 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 46f43909-d681-4938-8253-5080b626e169] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:03:16.478287 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-5f8c3178-b571-4ff4-851a-95ca73a2c438 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:16.478774 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-5f8c3178-b571-4ff4-851a-95ca73a2c438 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:16.479548 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-5f8c3178-b571-4ff4-851a-95ca73a2c438 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:16.480016 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-5f8c3178-b571-4ff4-851a-95ca73a2c438 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:16.662911 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-5f8c3178-b571-4ff4-851a-95ca73a2c438 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:03:16.685884 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-5f8c3178-b571-4ff4-851a-95ca73a2c438 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:03:16.688090 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-5f8c3178-b571-4ff4-851a-95ca73a2c438 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:03:16.689858 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-5f8c3178-b571-4ff4-851a-95ca73a2c438 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169" status: 200 len: 1739 microversion: 2.20 time: 0.224781 Jun 16 23:03:16.703850 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 200/397] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 23:03:16 2022] GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169 => generated 1739 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 23:03:16.802102 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-0fca2190-51eb-4d5b-92f3-e89324d0ed99 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:03:16.802859 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-0fca2190-51eb-4d5b-92f3-e89324d0ed99 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] [instance: 22fa37ae-2cac-42ad-9332-ab7da7c574d5] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:03:16.809518 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-0fca2190-51eb-4d5b-92f3-e89324d0ed99 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:16.810184 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-0fca2190-51eb-4d5b-92f3-e89324d0ed99 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:16.811513 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-0fca2190-51eb-4d5b-92f3-e89324d0ed99 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:16.812218 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-0fca2190-51eb-4d5b-92f3-e89324d0ed99 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:16.968372 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-0fca2190-51eb-4d5b-92f3-e89324d0ed99 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3a2d16133b4af8a208682de8a7d111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0526c12e8bc947209e24daf5ddfad7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:03:16.977481 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-0fca2190-51eb-4d5b-92f3-e89324d0ed99 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] 10.222.0.17 "GET /compute/v2.1/servers/22fa37ae-2cac-42ad-9332-ab7da7c574d5" status: 200 len: 1367 microversion: 2.1 time: 0.180245 Jun 16 23:03:16.978693 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 198/398] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:03:16 2022] GET /compute/v2.1/servers/22fa37ae-2cac-42ad-9332-ab7da7c574d5 => generated 1367 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:03:17.185288 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [req-303958b8-b9f8-496c-9985-76dfabbcf454 req-94541a27-0e1a-42bf-9023-e680eef679ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46f43909-d681-4938-8253-5080b626e169", "name": "network-vif-plugged", "status": "completed", "tag": "42e82895-598b-468f-aac2-e51ebe9d9946"}]} {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 23:03:17.207390 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-303958b8-b9f8-496c-9985-76dfabbcf454 req-94541a27-0e1a-42bf-9023-e680eef679ca service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:17.207929 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-303958b8-b9f8-496c-9985-76dfabbcf454 req-94541a27-0e1a-42bf-9023-e680eef679ca service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:17.223160 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.compute.server_external_events [req-303958b8-b9f8-496c-9985-76dfabbcf454 req-94541a27-0e1a-42bf-9023-e680eef679ca service nova] Creating event network-vif-plugged:42e82895-598b-468f-aac2-e51ebe9d9946 for instance 46f43909-d681-4938-8253-5080b626e169 on hv-cinder-84623 Jun 16 23:03:17.230515 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [req-303958b8-b9f8-496c-9985-76dfabbcf454 req-94541a27-0e1a-42bf-9023-e680eef679ca service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048719 Jun 16 23:03:17.250088 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 201/399] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 23:03:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 23:03:17.724358 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-920489b0-488d-4fec-b1fa-7cebc075cb40 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:03:17.724904 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-920489b0-488d-4fec-b1fa-7cebc075cb40 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 46f43909-d681-4938-8253-5080b626e169] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:03:17.737294 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-920489b0-488d-4fec-b1fa-7cebc075cb40 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:17.737759 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-920489b0-488d-4fec-b1fa-7cebc075cb40 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:17.739261 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-920489b0-488d-4fec-b1fa-7cebc075cb40 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:17.740250 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-920489b0-488d-4fec-b1fa-7cebc075cb40 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:17.748038 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG dbcounter [-] [117562] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 23:03:17.921623 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-920489b0-488d-4fec-b1fa-7cebc075cb40 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:03:17.931413 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-920489b0-488d-4fec-b1fa-7cebc075cb40 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:03:17.932934 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-920489b0-488d-4fec-b1fa-7cebc075cb40 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:03:17.934092 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-920489b0-488d-4fec-b1fa-7cebc075cb40 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169" status: 200 len: 1739 microversion: 2.20 time: 0.226819 Jun 16 23:03:17.934654 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 199/400] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 23:03:17 2022] GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169 => generated 1739 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 23:03:17.997277 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-c82d877f-23bf-4cbd-a1be-76b8c65e8222 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:03:17.997902 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-c82d877f-23bf-4cbd-a1be-76b8c65e8222 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] [instance: 22fa37ae-2cac-42ad-9332-ab7da7c574d5] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:03:18.004969 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-c82d877f-23bf-4cbd-a1be-76b8c65e8222 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:18.005347 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-c82d877f-23bf-4cbd-a1be-76b8c65e8222 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:18.006272 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-c82d877f-23bf-4cbd-a1be-76b8c65e8222 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:18.006563 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-c82d877f-23bf-4cbd-a1be-76b8c65e8222 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:18.155626 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-c82d877f-23bf-4cbd-a1be-76b8c65e8222 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3a2d16133b4af8a208682de8a7d111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0526c12e8bc947209e24daf5ddfad7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:03:18.163792 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-c82d877f-23bf-4cbd-a1be-76b8c65e8222 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] 10.222.0.17 "GET /compute/v2.1/servers/22fa37ae-2cac-42ad-9332-ab7da7c574d5" status: 200 len: 1557 microversion: 2.1 time: 0.171891 Jun 16 23:03:18.164631 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 202/401] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:03:17 2022] GET /compute/v2.1/servers/22fa37ae-2cac-42ad-9332-ab7da7c574d5 => generated 1557 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:03:18.181068 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-797a3cd1-ed76-4fe3-b5a8-c3557ef036c3 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:03:18.181556 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-797a3cd1-ed76-4fe3-b5a8-c3557ef036c3 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] [instance: 22fa37ae-2cac-42ad-9332-ab7da7c574d5] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:03:18.188087 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-797a3cd1-ed76-4fe3-b5a8-c3557ef036c3 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:18.188535 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-797a3cd1-ed76-4fe3-b5a8-c3557ef036c3 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:18.189304 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-797a3cd1-ed76-4fe3-b5a8-c3557ef036c3 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:18.189742 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-797a3cd1-ed76-4fe3-b5a8-c3557ef036c3 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:18.303037 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-797a3cd1-ed76-4fe3-b5a8-c3557ef036c3 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] 10.222.0.17 "GET /compute/v2.1/servers/22fa37ae-2cac-42ad-9332-ab7da7c574d5/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.117992 Jun 16 23:03:18.303037 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 200/402] 10.222.0.17 () {58 vars in 1274 bytes} [Thu Jun 16 23:03:18 2022] GET /compute/v2.1/servers/22fa37ae-2cac-42ad-9332-ab7da7c574d5/os-interface => generated 285 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 23:03:18.952393 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-f3a5bad9-9169-4441-8f63-20e6f62fdea8 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:03:18.954736 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-f3a5bad9-9169-4441-8f63-20e6f62fdea8 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 46f43909-d681-4938-8253-5080b626e169] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:03:18.961575 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-f3a5bad9-9169-4441-8f63-20e6f62fdea8 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:18.962845 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-f3a5bad9-9169-4441-8f63-20e6f62fdea8 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:18.963030 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-f3a5bad9-9169-4441-8f63-20e6f62fdea8 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:18.964573 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-f3a5bad9-9169-4441-8f63-20e6f62fdea8 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:19.243529 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-f3a5bad9-9169-4441-8f63-20e6f62fdea8 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:03:19.254849 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-f3a5bad9-9169-4441-8f63-20e6f62fdea8 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:03:19.257001 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-f3a5bad9-9169-4441-8f63-20e6f62fdea8 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:03:19.258393 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-f3a5bad9-9169-4441-8f63-20e6f62fdea8 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169" status: 200 len: 1739 microversion: 2.20 time: 0.309928 Jun 16 23:03:19.259289 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 203/403] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 23:03:18 2022] GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169 => generated 1739 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 23:03:19.650106 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [req-ba654a36-e60f-4a79-ac15-a98c1d877bef req-781c3b08-bea5-4bf5-b300-77f17c1cac0e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22fa37ae-2cac-42ad-9332-ab7da7c574d5", "tag": "e50a352e-8b05-48d5-9a0b-3df6a0efc12b"}]} {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 23:03:19.667414 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [req-ba654a36-e60f-4a79-ac15-a98c1d877bef req-781c3b08-bea5-4bf5-b300-77f17c1cac0e service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:19.668131 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [req-ba654a36-e60f-4a79-ac15-a98c1d877bef req-781c3b08-bea5-4bf5-b300-77f17c1cac0e service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:19.682011 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.compute.server_external_events [req-ba654a36-e60f-4a79-ac15-a98c1d877bef req-781c3b08-bea5-4bf5-b300-77f17c1cac0e service nova] Creating event network-changed:e50a352e-8b05-48d5-9a0b-3df6a0efc12b for instance 22fa37ae-2cac-42ad-9332-ab7da7c574d5 on hv-cinder-84623 Jun 16 23:03:19.688700 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [req-ba654a36-e60f-4a79-ac15-a98c1d877bef req-781c3b08-bea5-4bf5-b300-77f17c1cac0e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042104 Jun 16 23:03:19.689581 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 201/404] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 23:03:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 23:03:20.278885 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-4b6b604c-0c8e-492b-8be3-30d459872932 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:03:20.280992 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-4b6b604c-0c8e-492b-8be3-30d459872932 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 46f43909-d681-4938-8253-5080b626e169] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:03:20.295730 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-4b6b604c-0c8e-492b-8be3-30d459872932 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:20.296497 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-4b6b604c-0c8e-492b-8be3-30d459872932 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:20.301533 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-4b6b604c-0c8e-492b-8be3-30d459872932 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:20.302172 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-4b6b604c-0c8e-492b-8be3-30d459872932 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:20.489967 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-4b6b604c-0c8e-492b-8be3-30d459872932 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:03:20.511408 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-4b6b604c-0c8e-492b-8be3-30d459872932 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:03:20.513674 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-4b6b604c-0c8e-492b-8be3-30d459872932 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:03:20.515084 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-4b6b604c-0c8e-492b-8be3-30d459872932 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169" status: 200 len: 1739 microversion: 2.20 time: 0.241080 Jun 16 23:03:20.526085 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 204/405] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 23:03:20 2022] GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169 => generated 1739 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 23:03:21.537718 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-f38a2e44-67af-466d-ae6b-749b05522b67 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:03:21.538434 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-f38a2e44-67af-466d-ae6b-749b05522b67 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 46f43909-d681-4938-8253-5080b626e169] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:03:21.540724 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG dbcounter [-] [117562] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=1 {{(pid=117562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 23:03:21.548587 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-f38a2e44-67af-466d-ae6b-749b05522b67 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:21.549794 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-f38a2e44-67af-466d-ae6b-749b05522b67 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:21.552710 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-f38a2e44-67af-466d-ae6b-749b05522b67 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:21.553484 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-f38a2e44-67af-466d-ae6b-749b05522b67 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:21.738552 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-f38a2e44-67af-466d-ae6b-749b05522b67 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:03:21.754446 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-f38a2e44-67af-466d-ae6b-749b05522b67 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:03:21.757086 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-f38a2e44-67af-466d-ae6b-749b05522b67 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:03:21.766448 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-f38a2e44-67af-466d-ae6b-749b05522b67 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169" status: 200 len: 1739 microversion: 2.20 time: 0.231137 Jun 16 23:03:21.767361 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 202/406] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 23:03:21 2022] GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169 => generated 1739 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 23:03:22.785333 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-426f8924-396d-4ded-8c8a-97b5d4b68ae0 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:03:22.785934 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-426f8924-396d-4ded-8c8a-97b5d4b68ae0 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 46f43909-d681-4938-8253-5080b626e169] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:03:22.792868 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-426f8924-396d-4ded-8c8a-97b5d4b68ae0 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:22.793550 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-426f8924-396d-4ded-8c8a-97b5d4b68ae0 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:22.794475 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-426f8924-396d-4ded-8c8a-97b5d4b68ae0 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:22.795081 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-426f8924-396d-4ded-8c8a-97b5d4b68ae0 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:22.943772 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-426f8924-396d-4ded-8c8a-97b5d4b68ae0 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:03:22.953371 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-426f8924-396d-4ded-8c8a-97b5d4b68ae0 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:03:22.955102 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-426f8924-396d-4ded-8c8a-97b5d4b68ae0 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:03:22.957352 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-426f8924-396d-4ded-8c8a-97b5d4b68ae0 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169" status: 200 len: 1739 microversion: 2.20 time: 0.176049 Jun 16 23:03:22.968673 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 205/407] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 23:03:22 2022] GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169 => generated 1739 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 23:03:23.978518 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-53878505-dc00-48cd-ad91-9e5478257d8e tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:03:23.980032 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-53878505-dc00-48cd-ad91-9e5478257d8e tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 46f43909-d681-4938-8253-5080b626e169] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:03:23.988728 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-53878505-dc00-48cd-ad91-9e5478257d8e tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:23.989788 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-53878505-dc00-48cd-ad91-9e5478257d8e tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:23.990740 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-53878505-dc00-48cd-ad91-9e5478257d8e tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:23.991253 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-53878505-dc00-48cd-ad91-9e5478257d8e tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:24.154133 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-53878505-dc00-48cd-ad91-9e5478257d8e tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:03:24.165451 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-53878505-dc00-48cd-ad91-9e5478257d8e tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:03:24.167115 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-53878505-dc00-48cd-ad91-9e5478257d8e tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:03:24.168371 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-53878505-dc00-48cd-ad91-9e5478257d8e tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169" status: 200 len: 1739 microversion: 2.20 time: 0.195507 Jun 16 23:03:24.169154 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 203/408] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 23:03:23 2022] GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169 => generated 1739 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 23:03:25.186452 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-80635a26-d0f7-4973-abef-bf3150dd6a83 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:03:25.187247 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-80635a26-d0f7-4973-abef-bf3150dd6a83 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 46f43909-d681-4938-8253-5080b626e169] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:03:25.194093 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-80635a26-d0f7-4973-abef-bf3150dd6a83 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:25.194540 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-80635a26-d0f7-4973-abef-bf3150dd6a83 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:25.195324 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-80635a26-d0f7-4973-abef-bf3150dd6a83 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:25.195763 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-80635a26-d0f7-4973-abef-bf3150dd6a83 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:25.325874 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-80635a26-d0f7-4973-abef-bf3150dd6a83 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:03:25.334073 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-80635a26-d0f7-4973-abef-bf3150dd6a83 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:03:25.335603 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-80635a26-d0f7-4973-abef-bf3150dd6a83 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:03:25.336763 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-80635a26-d0f7-4973-abef-bf3150dd6a83 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169" status: 200 len: 1739 microversion: 2.20 time: 0.154209 Jun 16 23:03:25.337324 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 206/409] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 23:03:25 2022] GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169 => generated 1739 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 23:03:26.355163 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-c4f079d7-ddb7-4d56-9eab-a8dc6643a019 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:03:26.355886 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-c4f079d7-ddb7-4d56-9eab-a8dc6643a019 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 46f43909-d681-4938-8253-5080b626e169] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:03:26.362562 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-c4f079d7-ddb7-4d56-9eab-a8dc6643a019 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:26.363040 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-c4f079d7-ddb7-4d56-9eab-a8dc6643a019 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:26.363816 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-c4f079d7-ddb7-4d56-9eab-a8dc6643a019 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:26.364251 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-c4f079d7-ddb7-4d56-9eab-a8dc6643a019 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:26.715564 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-c4f079d7-ddb7-4d56-9eab-a8dc6643a019 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:03:26.724605 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-c4f079d7-ddb7-4d56-9eab-a8dc6643a019 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:03:26.727167 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-c4f079d7-ddb7-4d56-9eab-a8dc6643a019 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:03:26.729076 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-c4f079d7-ddb7-4d56-9eab-a8dc6643a019 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169" status: 200 len: 1721 microversion: 2.20 time: 0.377637 Jun 16 23:03:26.729655 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 204/410] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 23:03:26 2022] GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169 => generated 1721 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 23:03:27.748261 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-1866879c-0c86-4407-9542-3ea616f3ff0c tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:03:27.748860 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-1866879c-0c86-4407-9542-3ea616f3ff0c tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 46f43909-d681-4938-8253-5080b626e169] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:03:27.755292 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-1866879c-0c86-4407-9542-3ea616f3ff0c tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:27.755777 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-1866879c-0c86-4407-9542-3ea616f3ff0c tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:27.756520 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-1866879c-0c86-4407-9542-3ea616f3ff0c tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:27.756923 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-1866879c-0c86-4407-9542-3ea616f3ff0c tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:27.890894 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-1866879c-0c86-4407-9542-3ea616f3ff0c tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:03:27.898870 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-1866879c-0c86-4407-9542-3ea616f3ff0c tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:03:27.900437 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-1866879c-0c86-4407-9542-3ea616f3ff0c tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:03:27.901593 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-1866879c-0c86-4407-9542-3ea616f3ff0c tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169" status: 200 len: 1721 microversion: 2.20 time: 0.157225 Jun 16 23:03:27.902149 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 207/411] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 23:03:27 2022] GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169 => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 23:03:28.919556 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-14d5383e-84ad-480f-b259-3106bace1619 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:03:28.920166 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-14d5383e-84ad-480f-b259-3106bace1619 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 46f43909-d681-4938-8253-5080b626e169] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:03:28.927147 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-14d5383e-84ad-480f-b259-3106bace1619 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:28.927592 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-14d5383e-84ad-480f-b259-3106bace1619 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:28.928357 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-14d5383e-84ad-480f-b259-3106bace1619 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:28.928793 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-14d5383e-84ad-480f-b259-3106bace1619 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:28.995927 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [req-c386a0bb-18df-4ebd-a0aa-c20d76d416b2 req-a772d8de-2a82-4664-aa20-0b69861bbfe3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46f43909-d681-4938-8253-5080b626e169", "name": "network-vif-unplugged", "status": "completed", "tag": "42e82895-598b-468f-aac2-e51ebe9d9946"}]} {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 23:03:29.006560 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-c386a0bb-18df-4ebd-a0aa-c20d76d416b2 req-a772d8de-2a82-4664-aa20-0b69861bbfe3 service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:29.007251 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-c386a0bb-18df-4ebd-a0aa-c20d76d416b2 req-a772d8de-2a82-4664-aa20-0b69861bbfe3 service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:29.023317 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.compute.server_external_events [req-c386a0bb-18df-4ebd-a0aa-c20d76d416b2 req-a772d8de-2a82-4664-aa20-0b69861bbfe3 service nova] Unable to find a host for instance 46f43909-d681-4938-8253-5080b626e169. Dropping event network-vif-unplugged {{(pid=117563) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 16 23:03:29.024447 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [req-c386a0bb-18df-4ebd-a0aa-c20d76d416b2 req-a772d8de-2a82-4664-aa20-0b69861bbfe3 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.032872 Jun 16 23:03:29.025476 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 208/412] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 23:03:28 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 34 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jun 16 23:03:29.073963 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-14d5383e-84ad-480f-b259-3106bace1619 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:03:29.081797 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-14d5383e-84ad-480f-b259-3106bace1619 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:03:29.083304 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-14d5383e-84ad-480f-b259-3106bace1619 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:03:29.084483 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-14d5383e-84ad-480f-b259-3106bace1619 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169" status: 200 len: 1664 microversion: 2.20 time: 0.168849 Jun 16 23:03:29.085010 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 205/413] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 23:03:28 2022] GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169 => generated 1664 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 23:03:29.102266 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-570af264-3a7a-4c13-8488-cd4a0ee1aae0 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9962b4a2-a75f-4d66-aff4-0fd3ad9fff6f"}} {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 23:03:29.103468 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-570af264-3a7a-4c13-8488-cd4a0ee1aae0 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 46f43909-d681-4938-8253-5080b626e169] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:03:29.109339 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-570af264-3a7a-4c13-8488-cd4a0ee1aae0 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:29.109785 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-570af264-3a7a-4c13-8488-cd4a0ee1aae0 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:29.110537 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-570af264-3a7a-4c13-8488-cd4a0ee1aae0 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:29.111019 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-570af264-3a7a-4c13-8488-cd4a0ee1aae0 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:29.179956 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG dbcounter [-] [117563] Writing DB stats nova_cell1:SELECT=100 {{(pid=117563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 23:03:29.384533 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-570af264-3a7a-4c13-8488-cd4a0ee1aae0 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "POST /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.286149 Jun 16 23:03:29.385144 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 209/414] 10.222.0.17 () {62 vars in 1363 bytes} [Thu Jun 16 23:03:29 2022] POST /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169/os-volume_attachments => generated 188 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 23:03:29.505306 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-70e3ac4f-a815-409d-94da-d49be279a404 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 23:03:29.505863 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-70e3ac4f-a815-409d-94da-d49be279a404 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 46f43909-d681-4938-8253-5080b626e169] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:03:29.512979 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-70e3ac4f-a815-409d-94da-d49be279a404 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:29.513437 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-70e3ac4f-a815-409d-94da-d49be279a404 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:29.514202 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-70e3ac4f-a815-409d-94da-d49be279a404 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:29.514695 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-70e3ac4f-a815-409d-94da-d49be279a404 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:29.605830 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-70e3ac4f-a815-409d-94da-d49be279a404 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "POST /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169/action" status: 202 len: 0 microversion: 2.20 time: 0.104509 Jun 16 23:03:29.606484 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 206/415] 10.222.0.17 () {62 vars in 1318 bytes} [Thu Jun 16 23:03:29 2022] POST /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169/action => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 16 23:03:29.614862 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-cecee4f8-62aa-4b6d-9d70-f372413c3113 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:03:29.615466 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-cecee4f8-62aa-4b6d-9d70-f372413c3113 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 46f43909-d681-4938-8253-5080b626e169] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:03:29.622177 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-cecee4f8-62aa-4b6d-9d70-f372413c3113 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:29.622645 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-cecee4f8-62aa-4b6d-9d70-f372413c3113 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:29.623504 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-cecee4f8-62aa-4b6d-9d70-f372413c3113 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:29.623962 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-cecee4f8-62aa-4b6d-9d70-f372413c3113 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:29.773921 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-cecee4f8-62aa-4b6d-9d70-f372413c3113 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:03:29.785495 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-cecee4f8-62aa-4b6d-9d70-f372413c3113 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:03:29.787789 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-cecee4f8-62aa-4b6d-9d70-f372413c3113 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:03:29.789397 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-cecee4f8-62aa-4b6d-9d70-f372413c3113 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169" status: 200 len: 1750 microversion: 2.20 time: 0.178498 Jun 16 23:03:29.790171 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 210/416] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 23:03:29 2022] GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169 => generated 1750 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 23:03:30.809024 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-56dda0c7-495c-4aae-b13f-b0c7fe3cb8af tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:03:30.809659 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-56dda0c7-495c-4aae-b13f-b0c7fe3cb8af tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 46f43909-d681-4938-8253-5080b626e169] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:03:30.816725 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-56dda0c7-495c-4aae-b13f-b0c7fe3cb8af tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:30.817690 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-56dda0c7-495c-4aae-b13f-b0c7fe3cb8af tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:30.818060 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-56dda0c7-495c-4aae-b13f-b0c7fe3cb8af tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:30.818501 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-56dda0c7-495c-4aae-b13f-b0c7fe3cb8af tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:30.956330 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-56dda0c7-495c-4aae-b13f-b0c7fe3cb8af tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:03:30.964687 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-56dda0c7-495c-4aae-b13f-b0c7fe3cb8af tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:03:30.966160 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-56dda0c7-495c-4aae-b13f-b0c7fe3cb8af tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:03:30.967337 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-56dda0c7-495c-4aae-b13f-b0c7fe3cb8af tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169" status: 200 len: 1752 microversion: 2.20 time: 0.162911 Jun 16 23:03:30.967890 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 207/417] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 23:03:30 2022] GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169 => generated 1752 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 23:03:31.986898 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-57b7a1a5-86b1-4dda-b885-52b1815343e1 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:03:31.987503 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-57b7a1a5-86b1-4dda-b885-52b1815343e1 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 46f43909-d681-4938-8253-5080b626e169] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:03:31.994420 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-57b7a1a5-86b1-4dda-b885-52b1815343e1 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:31.994939 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-57b7a1a5-86b1-4dda-b885-52b1815343e1 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:31.995769 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-57b7a1a5-86b1-4dda-b885-52b1815343e1 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:31.996215 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-57b7a1a5-86b1-4dda-b885-52b1815343e1 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:32.129591 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-57b7a1a5-86b1-4dda-b885-52b1815343e1 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:03:32.139102 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-57b7a1a5-86b1-4dda-b885-52b1815343e1 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:03:32.140691 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-57b7a1a5-86b1-4dda-b885-52b1815343e1 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:03:32.141843 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-57b7a1a5-86b1-4dda-b885-52b1815343e1 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169" status: 200 len: 1808 microversion: 2.20 time: 0.159355 Jun 16 23:03:32.142668 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 211/418] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 23:03:31 2022] GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169 => generated 1808 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 23:03:33.166460 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-1fd75dad-fd6b-48af-8293-c444c401a03a tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:03:33.168509 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-1fd75dad-fd6b-48af-8293-c444c401a03a tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 46f43909-d681-4938-8253-5080b626e169] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:03:33.176988 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-1fd75dad-fd6b-48af-8293-c444c401a03a tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:33.177478 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-1fd75dad-fd6b-48af-8293-c444c401a03a tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:33.178422 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-1fd75dad-fd6b-48af-8293-c444c401a03a tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:33.178885 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-1fd75dad-fd6b-48af-8293-c444c401a03a tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:33.284510 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-07c35f3a-e342-450b-9434-d8d39da18fe2 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e597bb0c-c01e-43c6-9944-4cdcb6a2d9c2", "device": "/dev/sdb"}} {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 23:03:33.287372 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-07c35f3a-e342-450b-9434-d8d39da18fe2 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] [instance: 7e6c1a21-fd9c-4f9e-a23f-f2cacbdd2e7b] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:03:33.295932 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-07c35f3a-e342-450b-9434-d8d39da18fe2 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:33.296771 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-07c35f3a-e342-450b-9434-d8d39da18fe2 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:33.297921 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-07c35f3a-e342-450b-9434-d8d39da18fe2 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:33.299287 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-07c35f3a-e342-450b-9434-d8d39da18fe2 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:33.366613 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-1fd75dad-fd6b-48af-8293-c444c401a03a tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:03:33.376415 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-1fd75dad-fd6b-48af-8293-c444c401a03a tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:03:33.378098 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-1fd75dad-fd6b-48af-8293-c444c401a03a tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:03:33.379307 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-1fd75dad-fd6b-48af-8293-c444c401a03a tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169" status: 200 len: 1808 microversion: 2.20 time: 0.222118 Jun 16 23:03:33.379873 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 208/419] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 23:03:33 2022] GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169 => generated 1808 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 23:03:34.397333 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-7252278c-1307-4301-a127-c9a99ea48faf tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:03:34.398746 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-7252278c-1307-4301-a127-c9a99ea48faf tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 46f43909-d681-4938-8253-5080b626e169] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:03:34.406213 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-7252278c-1307-4301-a127-c9a99ea48faf tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:34.406752 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-7252278c-1307-4301-a127-c9a99ea48faf tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:34.407672 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-7252278c-1307-4301-a127-c9a99ea48faf tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:34.408672 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-7252278c-1307-4301-a127-c9a99ea48faf tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:34.543815 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-7252278c-1307-4301-a127-c9a99ea48faf tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:03:34.552720 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-7252278c-1307-4301-a127-c9a99ea48faf tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:03:34.554206 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-7252278c-1307-4301-a127-c9a99ea48faf tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:03:34.555389 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-7252278c-1307-4301-a127-c9a99ea48faf tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169" status: 200 len: 1808 microversion: 2.20 time: 0.162091 Jun 16 23:03:34.555944 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 209/420] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 23:03:34 2022] GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169 => generated 1808 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 23:03:35.573322 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-9afa919f-4e45-4716-995c-375e4fead82e tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:03:35.574020 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-9afa919f-4e45-4716-995c-375e4fead82e tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 46f43909-d681-4938-8253-5080b626e169] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:03:35.580862 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-9afa919f-4e45-4716-995c-375e4fead82e tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:35.581308 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-9afa919f-4e45-4716-995c-375e4fead82e tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:35.582077 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-9afa919f-4e45-4716-995c-375e4fead82e tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:35.582508 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-9afa919f-4e45-4716-995c-375e4fead82e tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:35.716153 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-9afa919f-4e45-4716-995c-375e4fead82e tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:03:35.725646 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-9afa919f-4e45-4716-995c-375e4fead82e tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:03:35.727488 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-9afa919f-4e45-4716-995c-375e4fead82e tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:03:35.728851 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-9afa919f-4e45-4716-995c-375e4fead82e tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169" status: 200 len: 1808 microversion: 2.20 time: 0.159454 Jun 16 23:03:35.729403 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 210/421] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 23:03:35 2022] GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169 => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 23:03:36.747378 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-2c0b3099-cefe-4fd2-973b-41a83e575572 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:03:36.748081 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-2c0b3099-cefe-4fd2-973b-41a83e575572 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 46f43909-d681-4938-8253-5080b626e169] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:03:36.754648 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-2c0b3099-cefe-4fd2-973b-41a83e575572 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:36.755101 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-2c0b3099-cefe-4fd2-973b-41a83e575572 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:36.755864 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-2c0b3099-cefe-4fd2-973b-41a83e575572 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:36.756298 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-2c0b3099-cefe-4fd2-973b-41a83e575572 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:36.899154 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-2c0b3099-cefe-4fd2-973b-41a83e575572 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:03:36.908939 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-2c0b3099-cefe-4fd2-973b-41a83e575572 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:03:36.910455 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-2c0b3099-cefe-4fd2-973b-41a83e575572 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:03:36.911645 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-2c0b3099-cefe-4fd2-973b-41a83e575572 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169" status: 200 len: 1808 microversion: 2.20 time: 0.168154 Jun 16 23:03:36.912594 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 211/422] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 23:03:36 2022] GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169 => generated 1808 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 23:03:37.930226 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-33debe8b-531b-4a6c-be27-25caf90a676b tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:03:37.930944 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-33debe8b-531b-4a6c-be27-25caf90a676b tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 46f43909-d681-4938-8253-5080b626e169] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:03:37.937320 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-33debe8b-531b-4a6c-be27-25caf90a676b tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:37.937776 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-33debe8b-531b-4a6c-be27-25caf90a676b tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:37.938541 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-33debe8b-531b-4a6c-be27-25caf90a676b tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:37.939594 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-33debe8b-531b-4a6c-be27-25caf90a676b tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:38.076276 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-33debe8b-531b-4a6c-be27-25caf90a676b tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:03:38.084668 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-33debe8b-531b-4a6c-be27-25caf90a676b tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:03:38.086179 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-33debe8b-531b-4a6c-be27-25caf90a676b tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:03:38.087373 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-33debe8b-531b-4a6c-be27-25caf90a676b tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169" status: 200 len: 1808 microversion: 2.20 time: 0.161021 Jun 16 23:03:38.088115 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 212/423] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 23:03:37 2022] GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169 => generated 1808 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 23:03:39.105432 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-83469e9d-f839-4366-a0bb-7233c5bf462a tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:03:39.106233 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-83469e9d-f839-4366-a0bb-7233c5bf462a tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 46f43909-d681-4938-8253-5080b626e169] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:03:39.112911 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-83469e9d-f839-4366-a0bb-7233c5bf462a tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:39.113364 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-83469e9d-f839-4366-a0bb-7233c5bf462a tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:39.114126 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-83469e9d-f839-4366-a0bb-7233c5bf462a tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:39.114565 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-83469e9d-f839-4366-a0bb-7233c5bf462a tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:39.256945 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-83469e9d-f839-4366-a0bb-7233c5bf462a tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:03:39.265923 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-83469e9d-f839-4366-a0bb-7233c5bf462a tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:03:39.268046 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-83469e9d-f839-4366-a0bb-7233c5bf462a tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:03:39.269206 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-83469e9d-f839-4366-a0bb-7233c5bf462a tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169" status: 200 len: 1808 microversion: 2.20 time: 0.167644 Jun 16 23:03:39.269950 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 213/424] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 23:03:39 2022] GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169 => generated 1808 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 23:03:40.287436 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-f11051f1-d838-4d05-8117-f8f91886627d tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:03:40.289094 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-f11051f1-d838-4d05-8117-f8f91886627d tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 46f43909-d681-4938-8253-5080b626e169] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:03:40.296247 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-f11051f1-d838-4d05-8117-f8f91886627d tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:40.297031 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-f11051f1-d838-4d05-8117-f8f91886627d tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:40.297911 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-f11051f1-d838-4d05-8117-f8f91886627d tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:40.298428 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-f11051f1-d838-4d05-8117-f8f91886627d tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:40.429911 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-f11051f1-d838-4d05-8117-f8f91886627d tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:03:40.438580 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-f11051f1-d838-4d05-8117-f8f91886627d tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:03:40.440119 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-f11051f1-d838-4d05-8117-f8f91886627d tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:03:40.441281 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-f11051f1-d838-4d05-8117-f8f91886627d tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169" status: 200 len: 1808 microversion: 2.20 time: 0.157770 Jun 16 23:03:40.441837 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 214/425] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 23:03:40 2022] GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169 => generated 1808 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 23:03:41.460001 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-823f6bc5-e348-4644-8f62-0819461d4d41 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:03:41.460779 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-823f6bc5-e348-4644-8f62-0819461d4d41 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 46f43909-d681-4938-8253-5080b626e169] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:03:41.468387 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-823f6bc5-e348-4644-8f62-0819461d4d41 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:41.468755 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-823f6bc5-e348-4644-8f62-0819461d4d41 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:41.469800 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-823f6bc5-e348-4644-8f62-0819461d4d41 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:41.470237 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-823f6bc5-e348-4644-8f62-0819461d4d41 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:41.607943 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-823f6bc5-e348-4644-8f62-0819461d4d41 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:03:41.610951 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG dbcounter [-] [117562] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 23:03:41.618544 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-823f6bc5-e348-4644-8f62-0819461d4d41 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:03:41.620146 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-823f6bc5-e348-4644-8f62-0819461d4d41 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:03:41.621308 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-823f6bc5-e348-4644-8f62-0819461d4d41 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169" status: 200 len: 1808 microversion: 2.20 time: 0.165377 Jun 16 23:03:41.622081 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 215/426] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 23:03:41 2022] GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169 => generated 1808 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 23:03:42.638957 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-8e6ac752-dfa6-4f75-bfaa-bc3c0cc96ee6 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:03:42.639664 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-8e6ac752-dfa6-4f75-bfaa-bc3c0cc96ee6 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 46f43909-d681-4938-8253-5080b626e169] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:03:42.647333 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-8e6ac752-dfa6-4f75-bfaa-bc3c0cc96ee6 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:42.647863 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-8e6ac752-dfa6-4f75-bfaa-bc3c0cc96ee6 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:42.648710 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-8e6ac752-dfa6-4f75-bfaa-bc3c0cc96ee6 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:42.649219 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-8e6ac752-dfa6-4f75-bfaa-bc3c0cc96ee6 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:42.790072 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-8e6ac752-dfa6-4f75-bfaa-bc3c0cc96ee6 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:03:42.800068 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-8e6ac752-dfa6-4f75-bfaa-bc3c0cc96ee6 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:03:42.801863 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-8e6ac752-dfa6-4f75-bfaa-bc3c0cc96ee6 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:03:42.803313 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-8e6ac752-dfa6-4f75-bfaa-bc3c0cc96ee6 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169" status: 200 len: 1808 microversion: 2.20 time: 0.168192 Jun 16 23:03:42.803867 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 216/427] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 23:03:42 2022] GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169 => generated 1808 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 23:03:43.296237 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG dbcounter [-] [117563] Writing DB stats nova_api:SELECT=51 {{(pid=117563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 23:03:43.404035 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG dbcounter [-] [117563] Writing DB stats nova_cell1:SELECT=27,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=117563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 23:03:43.825591 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-719e0153-a8de-4496-9dd9-c7d0430f9bca tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:03:43.826246 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-719e0153-a8de-4496-9dd9-c7d0430f9bca tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 46f43909-d681-4938-8253-5080b626e169] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:03:43.832916 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-719e0153-a8de-4496-9dd9-c7d0430f9bca tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:43.833363 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-719e0153-a8de-4496-9dd9-c7d0430f9bca tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:43.834125 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-719e0153-a8de-4496-9dd9-c7d0430f9bca tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:43.834560 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-719e0153-a8de-4496-9dd9-c7d0430f9bca tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:43.975098 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-719e0153-a8de-4496-9dd9-c7d0430f9bca tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:03:43.983589 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-719e0153-a8de-4496-9dd9-c7d0430f9bca tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:03:43.985584 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-719e0153-a8de-4496-9dd9-c7d0430f9bca tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:03:43.986785 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-719e0153-a8de-4496-9dd9-c7d0430f9bca tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169" status: 200 len: 1808 microversion: 2.20 time: 0.165318 Jun 16 23:03:43.987340 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 217/428] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 23:03:43 2022] GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169 => generated 1808 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 23:03:45.004125 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-0dbd996b-f572-4716-92a7-8737385d26c1 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:03:45.004817 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-0dbd996b-f572-4716-92a7-8737385d26c1 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 46f43909-d681-4938-8253-5080b626e169] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:03:45.011209 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-0dbd996b-f572-4716-92a7-8737385d26c1 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:45.011658 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-0dbd996b-f572-4716-92a7-8737385d26c1 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:45.012420 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-0dbd996b-f572-4716-92a7-8737385d26c1 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:45.012855 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-0dbd996b-f572-4716-92a7-8737385d26c1 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:45.142584 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-0dbd996b-f572-4716-92a7-8737385d26c1 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:03:45.151019 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-0dbd996b-f572-4716-92a7-8737385d26c1 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:03:45.152507 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-0dbd996b-f572-4716-92a7-8737385d26c1 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:03:45.153682 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-0dbd996b-f572-4716-92a7-8737385d26c1 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169" status: 200 len: 1808 microversion: 2.20 time: 0.153420 Jun 16 23:03:45.154231 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 218/429] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 23:03:44 2022] GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169 => generated 1808 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 23:03:45.451705 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-07c35f3a-e342-450b-9434-d8d39da18fe2 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] 10.222.0.17 "POST /compute/v2.1/servers/7e6c1a21-fd9c-4f9e-a23f-f2cacbdd2e7b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 12.172899 Jun 16 23:03:45.452329 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 212/430] 10.222.0.17 () {60 vars in 1322 bytes} [Thu Jun 16 23:03:33 2022] POST /compute/v2.1/servers/7e6c1a21-fd9c-4f9e-a23f-f2cacbdd2e7b/os-volume_attachments => generated 194 bytes in 12175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 23:03:46.171473 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-63168724-a97b-4fb2-8535-494aa6d7b27b tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:03:46.172065 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-63168724-a97b-4fb2-8535-494aa6d7b27b tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 46f43909-d681-4938-8253-5080b626e169] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:03:46.179794 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-63168724-a97b-4fb2-8535-494aa6d7b27b tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:46.180239 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-63168724-a97b-4fb2-8535-494aa6d7b27b tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:46.181185 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-63168724-a97b-4fb2-8535-494aa6d7b27b tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:46.181622 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-63168724-a97b-4fb2-8535-494aa6d7b27b tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:46.317427 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-63168724-a97b-4fb2-8535-494aa6d7b27b tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:03:46.325788 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-63168724-a97b-4fb2-8535-494aa6d7b27b tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:03:46.327295 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-63168724-a97b-4fb2-8535-494aa6d7b27b tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:03:46.328472 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-63168724-a97b-4fb2-8535-494aa6d7b27b tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169" status: 200 len: 1808 microversion: 2.20 time: 0.160852 Jun 16 23:03:46.329028 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 219/431] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 23:03:46 2022] GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169 => generated 1808 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 23:03:47.348490 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-644bec36-7d8d-4517-8883-1dd98420f19e tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:03:47.349187 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-644bec36-7d8d-4517-8883-1dd98420f19e tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 46f43909-d681-4938-8253-5080b626e169] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:03:47.355414 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-644bec36-7d8d-4517-8883-1dd98420f19e tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:47.355862 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-644bec36-7d8d-4517-8883-1dd98420f19e tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:47.356619 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-644bec36-7d8d-4517-8883-1dd98420f19e tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:47.357055 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-644bec36-7d8d-4517-8883-1dd98420f19e tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:47.482325 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-644bec36-7d8d-4517-8883-1dd98420f19e tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:03:47.491222 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-644bec36-7d8d-4517-8883-1dd98420f19e tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:03:47.492658 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-644bec36-7d8d-4517-8883-1dd98420f19e tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:03:47.493810 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-644bec36-7d8d-4517-8883-1dd98420f19e tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169" status: 200 len: 1808 microversion: 2.20 time: 0.150290 Jun 16 23:03:47.494360 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 213/432] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 23:03:47 2022] GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169 => generated 1808 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 23:03:48.512465 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-c7c8383b-069f-4e9f-af25-f8777653bc95 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:03:48.513063 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-c7c8383b-069f-4e9f-af25-f8777653bc95 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 46f43909-d681-4938-8253-5080b626e169] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:03:48.519813 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-c7c8383b-069f-4e9f-af25-f8777653bc95 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:48.520261 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-c7c8383b-069f-4e9f-af25-f8777653bc95 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:48.521055 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-c7c8383b-069f-4e9f-af25-f8777653bc95 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:48.521494 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-c7c8383b-069f-4e9f-af25-f8777653bc95 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:48.656023 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-c7c8383b-069f-4e9f-af25-f8777653bc95 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:03:48.665237 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-c7c8383b-069f-4e9f-af25-f8777653bc95 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:03:48.666759 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-c7c8383b-069f-4e9f-af25-f8777653bc95 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:03:48.667948 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-c7c8383b-069f-4e9f-af25-f8777653bc95 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169" status: 200 len: 1808 microversion: 2.20 time: 0.159418 Jun 16 23:03:48.668696 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 220/433] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 23:03:48 2022] GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169 => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 23:03:49.685852 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-82649aad-7188-46f3-9361-041546c903c8 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:03:49.686467 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-82649aad-7188-46f3-9361-041546c903c8 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 46f43909-d681-4938-8253-5080b626e169] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:03:49.692984 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-82649aad-7188-46f3-9361-041546c903c8 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:49.693436 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-82649aad-7188-46f3-9361-041546c903c8 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:49.694203 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-82649aad-7188-46f3-9361-041546c903c8 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:49.694676 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-82649aad-7188-46f3-9361-041546c903c8 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:49.765737 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-1c8c9ebe-380d-42aa-9104-75b465e2553d tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "69f331a4-aab1-45fb-8cec-8bbb86e65d81"}} {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 23:03:49.767341 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-1c8c9ebe-380d-42aa-9104-75b465e2553d tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] [instance: 8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:03:49.773468 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-1c8c9ebe-380d-42aa-9104-75b465e2553d tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:49.773922 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-1c8c9ebe-380d-42aa-9104-75b465e2553d tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:49.774730 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-1c8c9ebe-380d-42aa-9104-75b465e2553d tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:49.775173 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-1c8c9ebe-380d-42aa-9104-75b465e2553d tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:49.822127 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-82649aad-7188-46f3-9361-041546c903c8 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:03:49.831013 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-82649aad-7188-46f3-9361-041546c903c8 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:03:49.832505 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-82649aad-7188-46f3-9361-041546c903c8 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:03:49.833656 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-82649aad-7188-46f3-9361-041546c903c8 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169" status: 200 len: 1808 microversion: 2.20 time: 0.151717 Jun 16 23:03:49.834219 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 214/434] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 23:03:49 2022] GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169 => generated 1808 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 23:03:50.852763 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-f6ae1b8d-e4bb-4d95-891c-5996e857bd8b tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:03:50.853432 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-f6ae1b8d-e4bb-4d95-891c-5996e857bd8b tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 46f43909-d681-4938-8253-5080b626e169] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:03:50.859790 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-f6ae1b8d-e4bb-4d95-891c-5996e857bd8b tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:50.860231 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-f6ae1b8d-e4bb-4d95-891c-5996e857bd8b tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:50.862149 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-f6ae1b8d-e4bb-4d95-891c-5996e857bd8b tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:50.862979 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-f6ae1b8d-e4bb-4d95-891c-5996e857bd8b tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:50.997385 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-f6ae1b8d-e4bb-4d95-891c-5996e857bd8b tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:03:51.006070 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-f6ae1b8d-e4bb-4d95-891c-5996e857bd8b tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:03:51.007587 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-f6ae1b8d-e4bb-4d95-891c-5996e857bd8b tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:03:51.008720 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-f6ae1b8d-e4bb-4d95-891c-5996e857bd8b tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169" status: 200 len: 1808 microversion: 2.20 time: 0.159899 Jun 16 23:03:51.009271 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 215/435] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 23:03:50 2022] GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169 => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 23:03:52.027110 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-8091b765-9cd0-45b6-9630-bd546f8f2989 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:03:52.027777 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-8091b765-9cd0-45b6-9630-bd546f8f2989 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 46f43909-d681-4938-8253-5080b626e169] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:03:52.035809 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-8091b765-9cd0-45b6-9630-bd546f8f2989 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:52.036539 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-8091b765-9cd0-45b6-9630-bd546f8f2989 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:52.037874 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-8091b765-9cd0-45b6-9630-bd546f8f2989 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:52.038421 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-8091b765-9cd0-45b6-9630-bd546f8f2989 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:52.167572 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-8091b765-9cd0-45b6-9630-bd546f8f2989 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:03:52.177002 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-8091b765-9cd0-45b6-9630-bd546f8f2989 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:03:52.179882 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-8091b765-9cd0-45b6-9630-bd546f8f2989 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:03:52.181294 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-8091b765-9cd0-45b6-9630-bd546f8f2989 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169" status: 200 len: 1808 microversion: 2.20 time: 0.157942 Jun 16 23:03:52.181894 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 216/436] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 23:03:52 2022] GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169 => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 23:03:52.371104 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-1c8c9ebe-380d-42aa-9104-75b465e2553d tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] 10.222.0.17 "POST /compute/v2.1/servers/8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.609076 Jun 16 23:03:52.371724 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 221/437] 10.222.0.17 () {60 vars in 1322 bytes} [Thu Jun 16 23:03:49 2022] POST /compute/v2.1/servers/8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8/os-volume_attachments => generated 194 bytes in 2611 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 23:03:53.199563 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-ae5cb00f-f505-4364-aec4-3fa12300ab5d tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:03:53.200197 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-ae5cb00f-f505-4364-aec4-3fa12300ab5d tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 46f43909-d681-4938-8253-5080b626e169] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:03:53.207194 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-ae5cb00f-f505-4364-aec4-3fa12300ab5d tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:53.207650 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-ae5cb00f-f505-4364-aec4-3fa12300ab5d tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:53.208420 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-ae5cb00f-f505-4364-aec4-3fa12300ab5d tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:53.208859 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-ae5cb00f-f505-4364-aec4-3fa12300ab5d tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:53.341970 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-ae5cb00f-f505-4364-aec4-3fa12300ab5d tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:03:53.351008 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-ae5cb00f-f505-4364-aec4-3fa12300ab5d tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:03:53.352483 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-ae5cb00f-f505-4364-aec4-3fa12300ab5d tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:03:53.353618 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-ae5cb00f-f505-4364-aec4-3fa12300ab5d tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169" status: 200 len: 1808 microversion: 2.20 time: 0.157934 Jun 16 23:03:53.354178 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 217/438] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 23:03:53 2022] GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169 => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 23:03:54.372742 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-2663495f-8e22-490b-902a-47d1ae4ad7f4 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:03:54.373437 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-2663495f-8e22-490b-902a-47d1ae4ad7f4 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 46f43909-d681-4938-8253-5080b626e169] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:03:54.375369 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG dbcounter [-] [117562] Writing DB stats nova_api:SELECT=42 {{(pid=117562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 23:03:54.381365 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-2663495f-8e22-490b-902a-47d1ae4ad7f4 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:54.381817 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-2663495f-8e22-490b-902a-47d1ae4ad7f4 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:54.382604 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-2663495f-8e22-490b-902a-47d1ae4ad7f4 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:54.383048 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-2663495f-8e22-490b-902a-47d1ae4ad7f4 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:54.515727 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-2663495f-8e22-490b-902a-47d1ae4ad7f4 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:03:54.524128 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-2663495f-8e22-490b-902a-47d1ae4ad7f4 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:03:54.525625 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-2663495f-8e22-490b-902a-47d1ae4ad7f4 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:03:54.526804 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-2663495f-8e22-490b-902a-47d1ae4ad7f4 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169" status: 200 len: 1808 microversion: 2.20 time: 0.158769 Jun 16 23:03:54.527351 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 222/439] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 23:03:54 2022] GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169 => generated 1808 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 23:03:55.544507 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-259ccc9e-37b7-4b8a-a53e-a2c12662d1b0 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:03:55.544951 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-259ccc9e-37b7-4b8a-a53e-a2c12662d1b0 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 46f43909-d681-4938-8253-5080b626e169] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:03:55.556863 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-259ccc9e-37b7-4b8a-a53e-a2c12662d1b0 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:55.557582 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-259ccc9e-37b7-4b8a-a53e-a2c12662d1b0 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:55.558799 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-259ccc9e-37b7-4b8a-a53e-a2c12662d1b0 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:55.559562 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-259ccc9e-37b7-4b8a-a53e-a2c12662d1b0 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:55.699566 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-259ccc9e-37b7-4b8a-a53e-a2c12662d1b0 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:03:55.708935 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-259ccc9e-37b7-4b8a-a53e-a2c12662d1b0 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:03:55.710416 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-259ccc9e-37b7-4b8a-a53e-a2c12662d1b0 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:03:55.711590 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-259ccc9e-37b7-4b8a-a53e-a2c12662d1b0 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169" status: 200 len: 1808 microversion: 2.20 time: 0.171249 Jun 16 23:03:55.712379 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 218/440] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 23:03:55 2022] GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169 => generated 1808 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 23:03:56.730972 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-a1d5f448-c62b-4b04-9869-0ea793c28dbd tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:03:56.731579 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-a1d5f448-c62b-4b04-9869-0ea793c28dbd tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 46f43909-d681-4938-8253-5080b626e169] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:03:56.738126 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-a1d5f448-c62b-4b04-9869-0ea793c28dbd tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:56.738618 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-a1d5f448-c62b-4b04-9869-0ea793c28dbd tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:56.739468 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-a1d5f448-c62b-4b04-9869-0ea793c28dbd tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:56.739954 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-a1d5f448-c62b-4b04-9869-0ea793c28dbd tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:56.874251 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-a1d5f448-c62b-4b04-9869-0ea793c28dbd tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:03:56.883452 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-a1d5f448-c62b-4b04-9869-0ea793c28dbd tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:03:56.884953 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-a1d5f448-c62b-4b04-9869-0ea793c28dbd tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:03:56.886114 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-a1d5f448-c62b-4b04-9869-0ea793c28dbd tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169" status: 200 len: 1808 microversion: 2.20 time: 0.159520 Jun 16 23:03:56.886846 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 223/441] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 23:03:56 2022] GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169 => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 23:03:57.904711 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-af16295f-309b-4ace-82e2-bfb6a18cac3b tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:03:57.905340 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-af16295f-309b-4ace-82e2-bfb6a18cac3b tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 46f43909-d681-4938-8253-5080b626e169] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:03:57.912311 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-af16295f-309b-4ace-82e2-bfb6a18cac3b tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:57.912696 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-af16295f-309b-4ace-82e2-bfb6a18cac3b tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:57.913451 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-af16295f-309b-4ace-82e2-bfb6a18cac3b tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:57.913883 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-af16295f-309b-4ace-82e2-bfb6a18cac3b tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:58.038186 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-af16295f-309b-4ace-82e2-bfb6a18cac3b tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:03:58.046401 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-af16295f-309b-4ace-82e2-bfb6a18cac3b tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:03:58.047915 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-af16295f-309b-4ace-82e2-bfb6a18cac3b tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:03:58.049044 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-af16295f-309b-4ace-82e2-bfb6a18cac3b tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169" status: 200 len: 1808 microversion: 2.20 time: 0.148216 Jun 16 23:03:58.049598 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 219/442] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 23:03:57 2022] GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169 => generated 1808 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 23:03:59.067047 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-ff3342d7-6be3-41ba-beae-0b453e751005 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:03:59.067578 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-ff3342d7-6be3-41ba-beae-0b453e751005 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 46f43909-d681-4938-8253-5080b626e169] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:03:59.074090 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-ff3342d7-6be3-41ba-beae-0b453e751005 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:59.074538 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-ff3342d7-6be3-41ba-beae-0b453e751005 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:59.075331 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-ff3342d7-6be3-41ba-beae-0b453e751005 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:03:59.075766 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-ff3342d7-6be3-41ba-beae-0b453e751005 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:03:59.205178 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-ff3342d7-6be3-41ba-beae-0b453e751005 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:03:59.214115 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-ff3342d7-6be3-41ba-beae-0b453e751005 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:03:59.215818 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-ff3342d7-6be3-41ba-beae-0b453e751005 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:03:59.216988 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-ff3342d7-6be3-41ba-beae-0b453e751005 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169" status: 200 len: 1808 microversion: 2.20 time: 0.153859 Jun 16 23:03:59.217681 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 224/443] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 23:03:59 2022] GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169 => generated 1808 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 23:04:00.241060 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-09491d58-817f-44a8-ba9b-11bcb2dcdf9d tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:04:00.241708 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-09491d58-817f-44a8-ba9b-11bcb2dcdf9d tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 46f43909-d681-4938-8253-5080b626e169] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:04:00.248119 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-09491d58-817f-44a8-ba9b-11bcb2dcdf9d tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:00.248563 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-09491d58-817f-44a8-ba9b-11bcb2dcdf9d tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:00.249323 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-09491d58-817f-44a8-ba9b-11bcb2dcdf9d tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:00.249754 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-09491d58-817f-44a8-ba9b-11bcb2dcdf9d tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:00.375185 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-09491d58-817f-44a8-ba9b-11bcb2dcdf9d tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:04:00.383387 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-09491d58-817f-44a8-ba9b-11bcb2dcdf9d tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:04:00.385097 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-09491d58-817f-44a8-ba9b-11bcb2dcdf9d tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:04:00.386278 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-09491d58-817f-44a8-ba9b-11bcb2dcdf9d tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169" status: 200 len: 1808 microversion: 2.20 time: 0.149101 Jun 16 23:04:00.386855 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 220/444] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 23:04:00 2022] GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169 => generated 1808 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 23:04:00.827099 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [req-1876744d-1829-497d-aeec-8dfdb2b34d24 req-42c6be5e-eb88-4661-bfa7-e48622c4d13e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46f43909-d681-4938-8253-5080b626e169", "name": "network-vif-plugged", "status": "completed", "tag": "42e82895-598b-468f-aac2-e51ebe9d9946"}]} {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 23:04:00.837521 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [req-1876744d-1829-497d-aeec-8dfdb2b34d24 req-42c6be5e-eb88-4661-bfa7-e48622c4d13e service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:00.837979 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [req-1876744d-1829-497d-aeec-8dfdb2b34d24 req-42c6be5e-eb88-4661-bfa7-e48622c4d13e service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:00.850660 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.compute.server_external_events [req-1876744d-1829-497d-aeec-8dfdb2b34d24 req-42c6be5e-eb88-4661-bfa7-e48622c4d13e service nova] Creating event network-vif-plugged:42e82895-598b-468f-aac2-e51ebe9d9946 for instance 46f43909-d681-4938-8253-5080b626e169 on hv-cinder-84623 Jun 16 23:04:00.855602 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [req-1876744d-1829-497d-aeec-8dfdb2b34d24 req-42c6be5e-eb88-4661-bfa7-e48622c4d13e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032510 Jun 16 23:04:00.856535 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 225/445] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 23:04:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 23:04:01.405046 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-544d9ad8-2ac7-4a22-8fc7-601f15ab6942 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:04:01.406424 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-544d9ad8-2ac7-4a22-8fc7-601f15ab6942 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 46f43909-d681-4938-8253-5080b626e169] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:04:01.414144 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-544d9ad8-2ac7-4a22-8fc7-601f15ab6942 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:01.414907 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-544d9ad8-2ac7-4a22-8fc7-601f15ab6942 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:01.415988 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-544d9ad8-2ac7-4a22-8fc7-601f15ab6942 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:01.416432 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-544d9ad8-2ac7-4a22-8fc7-601f15ab6942 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:01.544654 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-544d9ad8-2ac7-4a22-8fc7-601f15ab6942 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:04:01.552932 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-544d9ad8-2ac7-4a22-8fc7-601f15ab6942 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:04:01.554417 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-544d9ad8-2ac7-4a22-8fc7-601f15ab6942 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:04:01.555786 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-544d9ad8-2ac7-4a22-8fc7-601f15ab6942 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169" status: 200 len: 1808 microversion: 2.20 time: 0.154827 Jun 16 23:04:01.556371 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 221/446] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 23:04:01 2022] GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169 => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 23:04:02.575399 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-a0bb7c65-d8ff-4286-b6b5-b79d0117066e tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:04:02.576014 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-a0bb7c65-d8ff-4286-b6b5-b79d0117066e tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 46f43909-d681-4938-8253-5080b626e169] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:04:02.582728 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-a0bb7c65-d8ff-4286-b6b5-b79d0117066e tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:02.583181 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-a0bb7c65-d8ff-4286-b6b5-b79d0117066e tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:02.583949 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-a0bb7c65-d8ff-4286-b6b5-b79d0117066e tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:02.584386 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-a0bb7c65-d8ff-4286-b6b5-b79d0117066e tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:02.723348 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-a0bb7c65-d8ff-4286-b6b5-b79d0117066e tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:04:02.732426 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-a0bb7c65-d8ff-4286-b6b5-b79d0117066e tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:04:02.733916 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-a0bb7c65-d8ff-4286-b6b5-b79d0117066e tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:04:02.735118 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-a0bb7c65-d8ff-4286-b6b5-b79d0117066e tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169" status: 200 len: 1808 microversion: 2.20 time: 0.164576 Jun 16 23:04:02.735662 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 226/447] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 23:04:02 2022] GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169 => generated 1808 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 23:04:03.752728 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-ac449973-b975-4323-a46c-4efc504dfca4 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:04:03.753480 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-ac449973-b975-4323-a46c-4efc504dfca4 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 46f43909-d681-4938-8253-5080b626e169] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:04:03.760320 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-ac449973-b975-4323-a46c-4efc504dfca4 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:03.760779 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-ac449973-b975-4323-a46c-4efc504dfca4 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:03.761556 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-ac449973-b975-4323-a46c-4efc504dfca4 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:03.762050 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-ac449973-b975-4323-a46c-4efc504dfca4 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:03.901434 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-ac449973-b975-4323-a46c-4efc504dfca4 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:04:03.910302 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-ac449973-b975-4323-a46c-4efc504dfca4 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:04:03.911836 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-ac449973-b975-4323-a46c-4efc504dfca4 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:04:03.912987 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-ac449973-b975-4323-a46c-4efc504dfca4 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169" status: 200 len: 1808 microversion: 2.20 time: 0.164063 Jun 16 23:04:03.913547 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 222/448] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 23:04:03 2022] GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169 => generated 1808 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 23:04:04.879000 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-9c782ecf-ec5a-404f-a142-3d1ea057dd98 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:04:04.883180 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-9c782ecf-ec5a-404f-a142-3d1ea057dd98 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] [instance: 7e6c1a21-fd9c-4f9e-a23f-f2cacbdd2e7b] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:04:04.889847 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-9c782ecf-ec5a-404f-a142-3d1ea057dd98 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:04.890874 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-9c782ecf-ec5a-404f-a142-3d1ea057dd98 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:04.891641 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-9c782ecf-ec5a-404f-a142-3d1ea057dd98 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:04.892075 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-9c782ecf-ec5a-404f-a142-3d1ea057dd98 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:04.932004 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-20682f8b-91ec-4ce8-8ba8-68f7f8e68892 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:04:04.932781 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-20682f8b-91ec-4ce8-8ba8-68f7f8e68892 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 46f43909-d681-4938-8253-5080b626e169] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:04:04.939614 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-20682f8b-91ec-4ce8-8ba8-68f7f8e68892 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:04.940183 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-20682f8b-91ec-4ce8-8ba8-68f7f8e68892 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:04.940962 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-20682f8b-91ec-4ce8-8ba8-68f7f8e68892 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:04.941458 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-20682f8b-91ec-4ce8-8ba8-68f7f8e68892 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:05.028246 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.objects.instance [None req-9c782ecf-ec5a-404f-a142-3d1ea057dd98 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Lazy-loading 'services' on Instance uuid 7e6c1a21-fd9c-4f9e-a23f-f2cacbdd2e7b {{(pid=117562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 23:04:05.089301 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-20682f8b-91ec-4ce8-8ba8-68f7f8e68892 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:04:05.099812 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-20682f8b-91ec-4ce8-8ba8-68f7f8e68892 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:04:05.101600 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-20682f8b-91ec-4ce8-8ba8-68f7f8e68892 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:04:05.102897 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-20682f8b-91ec-4ce8-8ba8-68f7f8e68892 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169" status: 200 len: 1795 microversion: 2.20 time: 0.174857 Jun 16 23:04:05.103608 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 223/449] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 23:04:04 2022] GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169 => generated 1795 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 23:04:05.153712 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-615da704-d0b3-4844-b313-db2b8490e53d tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 23:04:05.154766 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-615da704-d0b3-4844-b313-db2b8490e53d tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] [instance: 8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:04:05.158163 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-9c782ecf-ec5a-404f-a142-3d1ea057dd98 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] 10.222.0.17 "DELETE /compute/v2.1/servers/7e6c1a21-fd9c-4f9e-a23f-f2cacbdd2e7b/os-volume_attachments/e597bb0c-c01e-43c6-9944-4cdcb6a2d9c2" status: 202 len: 0 microversion: 2.1 time: 0.282945 Jun 16 23:04:05.158923 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 227/450] 10.222.0.17 () {58 vars in 1415 bytes} [Thu Jun 16 23:04:04 2022] DELETE /compute/v2.1/servers/7e6c1a21-fd9c-4f9e-a23f-f2cacbdd2e7b/os-volume_attachments/e597bb0c-c01e-43c6-9944-4cdcb6a2d9c2 => generated 0 bytes in 285 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 23:04:05.160998 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-615da704-d0b3-4844-b313-db2b8490e53d tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:05.161459 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-615da704-d0b3-4844-b313-db2b8490e53d tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:05.162861 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-615da704-d0b3-4844-b313-db2b8490e53d tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:05.163305 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-615da704-d0b3-4844-b313-db2b8490e53d tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:05.188393 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.objects.instance [None req-615da704-d0b3-4844-b313-db2b8490e53d tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lazy-loading 'flavor' on Instance uuid 8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8 {{(pid=117563) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 23:04:05.324495 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-615da704-d0b3-4844-b313-db2b8490e53d tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] 10.222.0.17 "POST /compute/v2.1/servers/8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8/action" status: 200 len: 32 microversion: 2.1 time: 0.174907 Jun 16 23:04:05.325101 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 224/451] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Jun 16 23:04:05 2022] POST /compute/v2.1/servers/8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8/action => generated 32 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 16 23:04:05.336048 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-9a729018-e8b2-41fc-b916-4005459b0151 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:04:05.336674 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-9a729018-e8b2-41fc-b916-4005459b0151 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] [instance: 8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:04:05.343443 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-9a729018-e8b2-41fc-b916-4005459b0151 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:05.343891 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-9a729018-e8b2-41fc-b916-4005459b0151 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:05.344655 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-9a729018-e8b2-41fc-b916-4005459b0151 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:05.345180 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-9a729018-e8b2-41fc-b916-4005459b0151 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:05.486336 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-9a729018-e8b2-41fc-b916-4005459b0151 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '243e592fbf1844d89f55dd5035a684f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60447df5461141e883d207e028b74bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:04:05.494246 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-9a729018-e8b2-41fc-b916-4005459b0151 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] 10.222.0.17 "GET /compute/v2.1/servers/8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8" status: 200 len: 1735 microversion: 2.1 time: 0.163260 Jun 16 23:04:05.494851 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 228/452] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:04:05 2022] GET /compute/v2.1/servers/8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8 => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:04:06.287614 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-787402f5-3b90-498e-9f7a-a26198bdd138 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:04:06.288201 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-787402f5-3b90-498e-9f7a-a26198bdd138 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] [instance: 7e6c1a21-fd9c-4f9e-a23f-f2cacbdd2e7b] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:04:06.294232 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-787402f5-3b90-498e-9f7a-a26198bdd138 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:06.294707 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-787402f5-3b90-498e-9f7a-a26198bdd138 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:06.295465 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-787402f5-3b90-498e-9f7a-a26198bdd138 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:06.295901 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-787402f5-3b90-498e-9f7a-a26198bdd138 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:06.320232 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-787402f5-3b90-498e-9f7a-a26198bdd138 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] [instance: 7e6c1a21-fd9c-4f9e-a23f-f2cacbdd2e7b] Going to try to terminate instance {{(pid=117563) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 23:04:06.334253 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG dbcounter [-] [117563] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=117563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 23:04:06.400237 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-787402f5-3b90-498e-9f7a-a26198bdd138 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] 10.222.0.17 "DELETE /compute/v2.1/servers/7e6c1a21-fd9c-4f9e-a23f-f2cacbdd2e7b" status: 204 len: 0 microversion: 2.1 time: 0.117151 Jun 16 23:04:06.400831 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 225/453] 10.222.0.17 () {58 vars in 1238 bytes} [Thu Jun 16 23:04:06 2022] DELETE /compute/v2.1/servers/7e6c1a21-fd9c-4f9e-a23f-f2cacbdd2e7b => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 23:04:06.409795 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-23f43415-c536-40de-86d9-fc90aafe7404 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:04:06.410454 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-23f43415-c536-40de-86d9-fc90aafe7404 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] [instance: 7e6c1a21-fd9c-4f9e-a23f-f2cacbdd2e7b] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:04:06.417161 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-23f43415-c536-40de-86d9-fc90aafe7404 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:06.417603 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-23f43415-c536-40de-86d9-fc90aafe7404 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:06.418372 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-23f43415-c536-40de-86d9-fc90aafe7404 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:06.419013 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-23f43415-c536-40de-86d9-fc90aafe7404 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:06.512397 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-0d50c707-d8bd-4454-9187-def7b159cd09 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:04:06.513068 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-0d50c707-d8bd-4454-9187-def7b159cd09 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] [instance: 8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:04:06.518972 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-0d50c707-d8bd-4454-9187-def7b159cd09 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:06.519431 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-0d50c707-d8bd-4454-9187-def7b159cd09 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:06.520180 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-0d50c707-d8bd-4454-9187-def7b159cd09 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:06.520610 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-0d50c707-d8bd-4454-9187-def7b159cd09 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:06.549887 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-23f43415-c536-40de-86d9-fc90aafe7404 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69163c28aa75492aa01c70532bed15a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9761759a69724a21b0b9315a931b106f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:04:06.557343 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-23f43415-c536-40de-86d9-fc90aafe7404 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] 10.222.0.17 "GET /compute/v2.1/servers/7e6c1a21-fd9c-4f9e-a23f-f2cacbdd2e7b" status: 200 len: 1515 microversion: 2.1 time: 0.152307 Jun 16 23:04:06.557992 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 229/454] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:04:06 2022] GET /compute/v2.1/servers/7e6c1a21-fd9c-4f9e-a23f-f2cacbdd2e7b => generated 1515 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:04:06.646579 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-0d50c707-d8bd-4454-9187-def7b159cd09 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '243e592fbf1844d89f55dd5035a684f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60447df5461141e883d207e028b74bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:04:06.654438 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-0d50c707-d8bd-4454-9187-def7b159cd09 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] 10.222.0.17 "GET /compute/v2.1/servers/8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8" status: 200 len: 1735 microversion: 2.1 time: 0.146224 Jun 16 23:04:06.655030 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 226/455] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:04:06 2022] GET /compute/v2.1/servers/8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8 => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 23:04:07.575109 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-e1563742-2909-4d08-a3ef-90f7490f716c tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:04:07.575624 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-e1563742-2909-4d08-a3ef-90f7490f716c tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] [instance: 7e6c1a21-fd9c-4f9e-a23f-f2cacbdd2e7b] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:04:07.582651 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-e1563742-2909-4d08-a3ef-90f7490f716c tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:07.583125 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-e1563742-2909-4d08-a3ef-90f7490f716c tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:07.583891 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-e1563742-2909-4d08-a3ef-90f7490f716c tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:07.584330 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-e1563742-2909-4d08-a3ef-90f7490f716c tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:07.672154 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-b7c35c90-65fa-4396-b6c7-38647b624234 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:04:07.672906 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-b7c35c90-65fa-4396-b6c7-38647b624234 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] [instance: 8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:04:07.679738 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-b7c35c90-65fa-4396-b6c7-38647b624234 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:07.680193 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-b7c35c90-65fa-4396-b6c7-38647b624234 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:07.680970 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-b7c35c90-65fa-4396-b6c7-38647b624234 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:07.681412 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-b7c35c90-65fa-4396-b6c7-38647b624234 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:07.715765 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-e1563742-2909-4d08-a3ef-90f7490f716c tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69163c28aa75492aa01c70532bed15a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9761759a69724a21b0b9315a931b106f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:04:07.723622 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-e1563742-2909-4d08-a3ef-90f7490f716c tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] 10.222.0.17 "GET /compute/v2.1/servers/7e6c1a21-fd9c-4f9e-a23f-f2cacbdd2e7b" status: 200 len: 1515 microversion: 2.1 time: 0.152385 Jun 16 23:04:07.724193 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 230/456] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:04:07 2022] GET /compute/v2.1/servers/7e6c1a21-fd9c-4f9e-a23f-f2cacbdd2e7b => generated 1515 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:04:07.811439 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-b7c35c90-65fa-4396-b6c7-38647b624234 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '243e592fbf1844d89f55dd5035a684f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60447df5461141e883d207e028b74bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:04:07.821221 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-b7c35c90-65fa-4396-b6c7-38647b624234 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] 10.222.0.17 "GET /compute/v2.1/servers/8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8" status: 200 len: 1735 microversion: 2.1 time: 0.152870 Jun 16 23:04:07.821786 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 227/457] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:04:07 2022] GET /compute/v2.1/servers/8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8 => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 23:04:08.740605 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-dbbf9b70-02ca-432e-a9dc-e3bc9d063213 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:04:08.741142 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-dbbf9b70-02ca-432e-a9dc-e3bc9d063213 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] [instance: 7e6c1a21-fd9c-4f9e-a23f-f2cacbdd2e7b] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:04:08.747767 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-dbbf9b70-02ca-432e-a9dc-e3bc9d063213 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:08.748221 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-dbbf9b70-02ca-432e-a9dc-e3bc9d063213 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:08.749029 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-dbbf9b70-02ca-432e-a9dc-e3bc9d063213 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:08.750031 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-dbbf9b70-02ca-432e-a9dc-e3bc9d063213 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:08.754614 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG dbcounter [-] [117562] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 23:04:08.837570 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-c99417e0-c12b-41a8-80f3-95bc3b2afddc tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:04:08.838179 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-c99417e0-c12b-41a8-80f3-95bc3b2afddc tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] [instance: 8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:04:08.847124 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-c99417e0-c12b-41a8-80f3-95bc3b2afddc tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:08.847574 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-c99417e0-c12b-41a8-80f3-95bc3b2afddc tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:08.848959 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-c99417e0-c12b-41a8-80f3-95bc3b2afddc tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:08.849455 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-c99417e0-c12b-41a8-80f3-95bc3b2afddc tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:08.906150 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-dbbf9b70-02ca-432e-a9dc-e3bc9d063213 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69163c28aa75492aa01c70532bed15a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9761759a69724a21b0b9315a931b106f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:04:08.920496 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-dbbf9b70-02ca-432e-a9dc-e3bc9d063213 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] 10.222.0.17 "GET /compute/v2.1/servers/7e6c1a21-fd9c-4f9e-a23f-f2cacbdd2e7b" status: 200 len: 1515 microversion: 2.1 time: 0.183753 Jun 16 23:04:08.921510 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 231/458] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:04:08 2022] GET /compute/v2.1/servers/7e6c1a21-fd9c-4f9e-a23f-f2cacbdd2e7b => generated 1515 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:04:08.926142 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [req-f290ebfd-cdb8-4800-a102-d1044a2ce0f6 req-5444e6c2-2397-43f4-9a3b-41756ff78f96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e6c1a21-fd9c-4f9e-a23f-f2cacbdd2e7b", "name": "network-vif-deleted", "tag": "9f27a5db-37c7-4f56-a95a-f2cd921a04db"}]} {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 23:04:08.934402 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [req-f290ebfd-cdb8-4800-a102-d1044a2ce0f6 req-5444e6c2-2397-43f4-9a3b-41756ff78f96 service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:08.934877 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [req-f290ebfd-cdb8-4800-a102-d1044a2ce0f6 req-5444e6c2-2397-43f4-9a3b-41756ff78f96 service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:08.946406 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.compute.server_external_events [req-f290ebfd-cdb8-4800-a102-d1044a2ce0f6 req-5444e6c2-2397-43f4-9a3b-41756ff78f96 service nova] Creating event network-vif-deleted:9f27a5db-37c7-4f56-a95a-f2cd921a04db for instance 7e6c1a21-fd9c-4f9e-a23f-f2cacbdd2e7b on hv-cinder-84623 Jun 16 23:04:08.951350 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [req-f290ebfd-cdb8-4800-a102-d1044a2ce0f6 req-5444e6c2-2397-43f4-9a3b-41756ff78f96 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028524 Jun 16 23:04:08.951935 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 232/459] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 23:04:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 23:04:09.004206 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-c99417e0-c12b-41a8-80f3-95bc3b2afddc tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '243e592fbf1844d89f55dd5035a684f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60447df5461141e883d207e028b74bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:04:09.012907 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-c99417e0-c12b-41a8-80f3-95bc3b2afddc tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] 10.222.0.17 "GET /compute/v2.1/servers/8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8" status: 200 len: 1735 microversion: 2.1 time: 0.179378 Jun 16 23:04:09.013752 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 228/460] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:04:08 2022] GET /compute/v2.1/servers/8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8 => generated 1735 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 23:04:09.938998 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-7d61c2ff-4157-4c25-aa50-4dc161a87236 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:04:09.939692 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-7d61c2ff-4157-4c25-aa50-4dc161a87236 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] [instance: 7e6c1a21-fd9c-4f9e-a23f-f2cacbdd2e7b] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:04:09.945839 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-7d61c2ff-4157-4c25-aa50-4dc161a87236 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:09.946291 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-7d61c2ff-4157-4c25-aa50-4dc161a87236 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:09.947079 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-7d61c2ff-4157-4c25-aa50-4dc161a87236 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:09.947517 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-7d61c2ff-4157-4c25-aa50-4dc161a87236 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:09.960331 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.wsgi [None req-7d61c2ff-4157-4c25-aa50-4dc161a87236 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] HTTP exception thrown: Instance 7e6c1a21-fd9c-4f9e-a23f-f2cacbdd2e7b could not be found. Jun 16 23:04:09.961898 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-7d61c2ff-4157-4c25-aa50-4dc161a87236 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Request method failure captured: Jun 16 23:04:09.961898 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: request: GET /compute/v2.1/servers/7e6c1a21-fd9c-4f9e-a23f-f2cacbdd2e7b HTTP/1.1 Jun 16 23:04:09.961898 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Accept: application/json Jun 16 23:04:09.961898 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Accept-Encoding: identity Jun 16 23:04:09.961898 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Connection: close Jun 16 23:04:09.961898 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Content-Length: 0 Jun 16 23:04:09.961898 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Content-Type: application/json Jun 16 23:04:09.961898 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Host: 10.222.0.17 Jun 16 23:04:09.961898 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Openstack-System-Scope: None Jun 16 23:04:09.961898 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: User-Agent: python-urllib3/1.26.9 Jun 16 23:04:09.961898 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Auth-Token: gAAAAABiq7ahjtbRlMoZzrwnXVTID6IyF3UZ9_FACbNOVNGnH_qRHyl7gTANWAFewHIiP7z3aLG9bSxIg9tQ9Yb_gSd_0yTMIP1kQXFb7-CjwZkVGglByREITIbsjaJihqHrGaWodzkGndPHh6sYPFYyHd9362qhfeoQxp37-toGzmsQ8YbBT_o Jun 16 23:04:09.961898 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Domain-Id: None Jun 16 23:04:09.961898 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Domain-Name: None Jun 16 23:04:09.961898 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Identity-Status: Confirmed Jun 16 23:04:09.961898 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Is-Admin-Project: True Jun 16 23:04:09.961898 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Project-Domain-Id: default Jun 16 23:04:09.961898 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Project-Domain-Name: Default Jun 16 23:04:09.961898 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Project-Id: 9761759a69724a21b0b9315a931b106f Jun 16 23:04:09.961898 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1423363191 Jun 16 23:04:09.961898 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Role: member,reader Jun 16 23:04:09.961898 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Roles: member,reader Jun 16 23:04:09.963460 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/9761759a69724a21b0b9315a931b106f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_9761759a69724a21b0b9315a931b106f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9761759a69724a21b0b9315a931b106f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9761759a69724a21b0b9315a931b106f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Jun 16 23:04:09.963460 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Tenant: tempest-VolumesSnapshotTestJSON-1423363191 Jun 16 23:04:09.963460 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Tenant-Id: 9761759a69724a21b0b9315a931b106f Jun 16 23:04:09.963460 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1423363191 Jun 16 23:04:09.963460 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-User: tempest-VolumesSnapshotTestJSON-1423363191-project Jun 16 23:04:09.963460 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-User-Domain-Id: default Jun 16 23:04:09.963460 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-User-Domain-Name: Default Jun 16 23:04:09.963460 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-User-Id: 69163c28aa75492aa01c70532bed15a9 Jun 16 23:04:09.963460 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-User-Name: tempest-VolumesSnapshotTestJSON-1423363191-project Jun 16 23:04:09.963460 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: method: > Jun 16 23:04:09.963460 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: exception: Instance 7e6c1a21-fd9c-4f9e-a23f-f2cacbdd2e7b could not be found. Jun 16 23:04:09.963460 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: action_args: {'id': '7e6c1a21-fd9c-4f9e-a23f-f2cacbdd2e7b'} Jun 16 23:04:09.964262 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 23:04:09.964262 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 23:04:09.964262 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 23:04:09.964262 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 23:04:09.964262 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 23:04:09.964262 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 23:04:09.964262 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 23:04:09.964262 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 23:04:09.964262 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 23:04:09.964262 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 23:04:09.964262 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e6c1a21-fd9c-4f9e-a23f-f2cacbdd2e7b could not be found. Jun 16 23:04:09.964262 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Jun 16 23:04:09.964262 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 23:04:09.964262 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Jun 16 23:04:09.964262 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 23:04:09.964262 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 23:04:09.964262 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 23:04:09.964262 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 23:04:09.964262 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 23:04:09.964262 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 23:04:09.965640 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 23:04:09.965640 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 23:04:09.965640 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 23:04:09.965640 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 23:04:09.965640 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 23:04:09.965640 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 23:04:09.965640 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 23:04:09.965640 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e6c1a21-fd9c-4f9e-a23f-f2cacbdd2e7b could not be found. Jun 16 23:04:09.965640 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Jun 16 23:04:09.965640 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 23:04:09.965640 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Jun 16 23:04:09.965640 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 23:04:09.965640 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 23:04:09.965640 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 23:04:09.965640 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 23:04:09.965640 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 23:04:09.965640 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e6c1a21-fd9c-4f9e-a23f-f2cacbdd2e7b could not be found. Jun 16 23:04:09.965640 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Jun 16 23:04:09.967182 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-7d61c2ff-4157-4c25-aa50-4dc161a87236 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Returning 404 to user: Instance 7e6c1a21-fd9c-4f9e-a23f-f2cacbdd2e7b could not be found. {{(pid=117562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 23:04:09.967182 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-7d61c2ff-4157-4c25-aa50-4dc161a87236 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] 10.222.0.17 "GET /compute/v2.1/servers/7e6c1a21-fd9c-4f9e-a23f-f2cacbdd2e7b" status: 404 len: 111 microversion: 2.1 time: 0.029094 Jun 16 23:04:09.967182 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 233/461] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:04:09 2022] GET /compute/v2.1/servers/7e6c1a21-fd9c-4f9e-a23f-f2cacbdd2e7b => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 23:04:10.032052 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-beffea2f-c79a-4f05-94fa-80ccc45ff4b5 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:04:10.033526 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-beffea2f-c79a-4f05-94fa-80ccc45ff4b5 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] [instance: 8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:04:10.040585 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-beffea2f-c79a-4f05-94fa-80ccc45ff4b5 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:10.041040 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-beffea2f-c79a-4f05-94fa-80ccc45ff4b5 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:10.041818 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-beffea2f-c79a-4f05-94fa-80ccc45ff4b5 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:10.042256 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-beffea2f-c79a-4f05-94fa-80ccc45ff4b5 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:10.181694 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-beffea2f-c79a-4f05-94fa-80ccc45ff4b5 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '243e592fbf1844d89f55dd5035a684f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60447df5461141e883d207e028b74bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:04:10.189957 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-beffea2f-c79a-4f05-94fa-80ccc45ff4b5 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] 10.222.0.17 "GET /compute/v2.1/servers/8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8" status: 200 len: 1735 microversion: 2.1 time: 0.162902 Jun 16 23:04:10.190254 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 229/462] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:04:10 2022] GET /compute/v2.1/servers/8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8 => generated 1735 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:04:11.206886 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-54d3dcd3-5f96-4896-b005-90ad0b1dbacc tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:04:11.207492 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-54d3dcd3-5f96-4896-b005-90ad0b1dbacc tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] [instance: 8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:04:11.213833 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-54d3dcd3-5f96-4896-b005-90ad0b1dbacc tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:11.214278 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-54d3dcd3-5f96-4896-b005-90ad0b1dbacc tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:11.215061 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-54d3dcd3-5f96-4896-b005-90ad0b1dbacc tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:11.215503 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-54d3dcd3-5f96-4896-b005-90ad0b1dbacc tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:11.348438 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-54d3dcd3-5f96-4896-b005-90ad0b1dbacc tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '243e592fbf1844d89f55dd5035a684f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60447df5461141e883d207e028b74bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:04:11.356296 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-54d3dcd3-5f96-4896-b005-90ad0b1dbacc tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] 10.222.0.17 "GET /compute/v2.1/servers/8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8" status: 200 len: 1735 microversion: 2.1 time: 0.153181 Jun 16 23:04:11.356849 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 234/463] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:04:11 2022] GET /compute/v2.1/servers/8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8 => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:04:12.373173 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-a73fa13b-7dd8-44c3-8dd8-cfa5915d18fc tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:04:12.374335 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-a73fa13b-7dd8-44c3-8dd8-cfa5915d18fc tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] [instance: 8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:04:12.380817 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-a73fa13b-7dd8-44c3-8dd8-cfa5915d18fc tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:12.381264 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-a73fa13b-7dd8-44c3-8dd8-cfa5915d18fc tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:12.382062 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-a73fa13b-7dd8-44c3-8dd8-cfa5915d18fc tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:12.382497 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-a73fa13b-7dd8-44c3-8dd8-cfa5915d18fc tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:12.508745 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-a73fa13b-7dd8-44c3-8dd8-cfa5915d18fc tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '243e592fbf1844d89f55dd5035a684f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60447df5461141e883d207e028b74bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:04:12.516558 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-a73fa13b-7dd8-44c3-8dd8-cfa5915d18fc tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] 10.222.0.17 "GET /compute/v2.1/servers/8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8" status: 200 len: 1735 microversion: 2.1 time: 0.147215 Jun 16 23:04:12.517125 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 230/464] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:04:12 2022] GET /compute/v2.1/servers/8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8 => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:04:13.533302 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-15d568df-2dba-49ad-9bdf-858cb312094a tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:04:13.533844 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-15d568df-2dba-49ad-9bdf-858cb312094a tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] [instance: 8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:04:13.540397 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-15d568df-2dba-49ad-9bdf-858cb312094a tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:13.540853 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-15d568df-2dba-49ad-9bdf-858cb312094a tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:13.541618 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-15d568df-2dba-49ad-9bdf-858cb312094a tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:13.542060 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-15d568df-2dba-49ad-9bdf-858cb312094a tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:13.667854 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-15d568df-2dba-49ad-9bdf-858cb312094a tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '243e592fbf1844d89f55dd5035a684f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60447df5461141e883d207e028b74bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:04:13.675761 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-15d568df-2dba-49ad-9bdf-858cb312094a tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] 10.222.0.17 "GET /compute/v2.1/servers/8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8" status: 200 len: 1735 microversion: 2.1 time: 0.146298 Jun 16 23:04:13.676325 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 235/465] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:04:13 2022] GET /compute/v2.1/servers/8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8 => generated 1735 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:04:14.693013 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-cc134671-1c20-4e19-a53d-8d43d2b98831 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:04:14.693616 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-cc134671-1c20-4e19-a53d-8d43d2b98831 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] [instance: 8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:04:14.696077 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG dbcounter [-] [117563] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1 {{(pid=117563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 23:04:14.701379 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-cc134671-1c20-4e19-a53d-8d43d2b98831 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:14.701829 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-cc134671-1c20-4e19-a53d-8d43d2b98831 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:14.702616 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-cc134671-1c20-4e19-a53d-8d43d2b98831 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:14.703057 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-cc134671-1c20-4e19-a53d-8d43d2b98831 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:14.838573 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-cc134671-1c20-4e19-a53d-8d43d2b98831 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '243e592fbf1844d89f55dd5035a684f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60447df5461141e883d207e028b74bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:04:14.847216 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-cc134671-1c20-4e19-a53d-8d43d2b98831 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] 10.222.0.17 "GET /compute/v2.1/servers/8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8" status: 200 len: 1735 microversion: 2.1 time: 0.158062 Jun 16 23:04:14.847776 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 231/466] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:04:14 2022] GET /compute/v2.1/servers/8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8 => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:04:15.864618 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-40d95e6a-069b-40da-bb8a-1e77117cdb73 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:04:15.865229 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-40d95e6a-069b-40da-bb8a-1e77117cdb73 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] [instance: 8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:04:15.871884 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-40d95e6a-069b-40da-bb8a-1e77117cdb73 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:15.872335 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-40d95e6a-069b-40da-bb8a-1e77117cdb73 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:15.873131 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-40d95e6a-069b-40da-bb8a-1e77117cdb73 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:15.873572 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-40d95e6a-069b-40da-bb8a-1e77117cdb73 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:16.000340 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-40d95e6a-069b-40da-bb8a-1e77117cdb73 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '243e592fbf1844d89f55dd5035a684f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60447df5461141e883d207e028b74bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:04:16.008314 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-40d95e6a-069b-40da-bb8a-1e77117cdb73 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] 10.222.0.17 "GET /compute/v2.1/servers/8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8" status: 200 len: 1735 microversion: 2.1 time: 0.147505 Jun 16 23:04:16.008874 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 236/467] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:04:15 2022] GET /compute/v2.1/servers/8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8 => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:04:17.025849 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-91604d07-50d9-4408-93d4-07462658ee53 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:04:17.026412 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-91604d07-50d9-4408-93d4-07462658ee53 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] [instance: 8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:04:17.033021 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-91604d07-50d9-4408-93d4-07462658ee53 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:17.033483 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-91604d07-50d9-4408-93d4-07462658ee53 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:17.034221 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-91604d07-50d9-4408-93d4-07462658ee53 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:17.034679 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-91604d07-50d9-4408-93d4-07462658ee53 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:17.163669 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-91604d07-50d9-4408-93d4-07462658ee53 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '243e592fbf1844d89f55dd5035a684f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60447df5461141e883d207e028b74bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:04:17.172048 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-91604d07-50d9-4408-93d4-07462658ee53 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] 10.222.0.17 "GET /compute/v2.1/servers/8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8" status: 200 len: 1735 microversion: 2.1 time: 0.150126 Jun 16 23:04:17.172597 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 232/468] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:04:17 2022] GET /compute/v2.1/servers/8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:04:18.189349 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-c0fe034e-eecc-4f18-8a06-757e9c3bd813 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:04:18.189956 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-c0fe034e-eecc-4f18-8a06-757e9c3bd813 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] [instance: 8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:04:18.196457 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-c0fe034e-eecc-4f18-8a06-757e9c3bd813 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:18.196915 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-c0fe034e-eecc-4f18-8a06-757e9c3bd813 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:18.197688 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-c0fe034e-eecc-4f18-8a06-757e9c3bd813 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:18.198137 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-c0fe034e-eecc-4f18-8a06-757e9c3bd813 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:18.326518 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-c0fe034e-eecc-4f18-8a06-757e9c3bd813 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '243e592fbf1844d89f55dd5035a684f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60447df5461141e883d207e028b74bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:04:18.334405 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-c0fe034e-eecc-4f18-8a06-757e9c3bd813 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] 10.222.0.17 "GET /compute/v2.1/servers/8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8" status: 200 len: 1735 microversion: 2.1 time: 0.149451 Jun 16 23:04:18.334995 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 237/469] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:04:18 2022] GET /compute/v2.1/servers/8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:04:18.594952 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-fe590188-31d5-4795-af86-df87d311d9f2 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:04:18.595470 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-fe590188-31d5-4795-af86-df87d311d9f2 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] [instance: f4c73822-1dfa-4eed-bf02-1123b0402755] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:04:18.601908 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-fe590188-31d5-4795-af86-df87d311d9f2 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:18.602363 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-fe590188-31d5-4795-af86-df87d311d9f2 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:18.603152 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-fe590188-31d5-4795-af86-df87d311d9f2 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:18.603594 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-fe590188-31d5-4795-af86-df87d311d9f2 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:18.725113 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.objects.instance [None req-fe590188-31d5-4795-af86-df87d311d9f2 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lazy-loading 'services' on Instance uuid f4c73822-1dfa-4eed-bf02-1123b0402755 {{(pid=117563) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 23:04:18.782528 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-8c40e864-f0b4-4a56-b3ea-283c4623a659 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1473239481", "imageRef": "2b486731-e5ea-4159-b6b1-ed0083e00543", "flavorRef": "452", "networks": [{"uuid": "47420daf-a76e-49b0-bb23-482a9b944fce"}]}} {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 23:04:18.834860 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.network.neutron [None req-8c40e864-f0b4-4a56-b3ea-283c4623a659 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] validate_networks() for [('47420daf-a76e-49b0-bb23-482a9b944fce', None, None, None, None, None)] {{(pid=117562) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 23:04:18.842720 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-fe590188-31d5-4795-af86-df87d311d9f2 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] 10.222.0.17 "DELETE /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755/os-volume_attachments/6f4c4fe3-f8fc-4888-9328-840899d54d05" status: 202 len: 0 microversion: 2.1 time: 0.252381 Jun 16 23:04:18.843492 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 233/470] 10.222.0.17 () {58 vars in 1415 bytes} [Thu Jun 16 23:04:18 2022] DELETE /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755/os-volume_attachments/6f4c4fe3-f8fc-4888-9328-840899d54d05 => generated 0 bytes in 254 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 23:04:19.185971 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.virt.hardware [None req-8c40e864-f0b4-4a56-b3ea-283c4623a659 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Flavor limits 0:0:0 {{(pid=117562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 23:04:19.186411 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.virt.hardware [None req-8c40e864-f0b4-4a56-b3ea-283c4623a659 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Image limits 0:0:0 {{(pid=117562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 23:04:19.187080 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.virt.hardware [None req-8c40e864-f0b4-4a56-b3ea-283c4623a659 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Flavor pref 0:0:0 {{(pid=117562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 23:04:19.187484 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.virt.hardware [None req-8c40e864-f0b4-4a56-b3ea-283c4623a659 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Image pref 0:0:0 {{(pid=117562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 23:04:19.187914 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.virt.hardware [None req-8c40e864-f0b4-4a56-b3ea-283c4623a659 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 23:04:19.197977 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-8c40e864-f0b4-4a56-b3ea-283c4623a659 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:19.198545 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-8c40e864-f0b4-4a56-b3ea-283c4623a659 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:19.199265 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-8c40e864-f0b4-4a56-b3ea-283c4623a659 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:19.199706 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-8c40e864-f0b4-4a56-b3ea-283c4623a659 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:19.216552 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.quota [None req-8c40e864-f0b4-4a56-b3ea-283c4623a659 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Getting quotas for project 9761759a69724a21b0b9315a931b106f. Resources: {'instances', 'cores', 'ram'} {{(pid=117562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 23:04:19.220449 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.quota [None req-8c40e864-f0b4-4a56-b3ea-283c4623a659 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Getting quotas for user 69163c28aa75492aa01c70532bed15a9 and project 9761759a69724a21b0b9315a931b106f. Resources: {'instances', 'cores', 'ram'} {{(pid=117562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 23:04:19.231154 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-8c40e864-f0b4-4a56-b3ea-283c4623a659 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Going to run 1 instances... {{(pid=117562) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 23:04:19.233915 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-8c40e864-f0b4-4a56-b3ea-283c4623a659 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] [instance: 85395b04-657c-4595-83ca-b6a1635f6daa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2b486731-e5ea-4159-b6b1-ed0083e00543',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 23:04:19.277568 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-8c40e864-f0b4-4a56-b3ea-283c4623a659 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.498780 Jun 16 23:04:19.278200 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 238/471] 10.222.0.17 () {60 vars in 1146 bytes} [Thu Jun 16 23:04:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 500 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 16 23:04:19.288743 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-0381c408-ae53-4390-8d95-bb52de21883c tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:04:19.289534 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-0381c408-ae53-4390-8d95-bb52de21883c tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] [instance: 85395b04-657c-4595-83ca-b6a1635f6daa] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:04:19.345037 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-0381c408-ae53-4390-8d95-bb52de21883c tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69163c28aa75492aa01c70532bed15a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9761759a69724a21b0b9315a931b106f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:04:19.351817 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-0381c408-ae53-4390-8d95-bb52de21883c tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] 10.222.0.17 "GET /compute/v2.1/servers/85395b04-657c-4595-83ca-b6a1635f6daa" status: 200 len: 1219 microversion: 2.1 time: 0.067371 Jun 16 23:04:19.352539 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 234/472] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:04:19 2022] GET /compute/v2.1/servers/85395b04-657c-4595-83ca-b6a1635f6daa => generated 1219 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:04:19.353088 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-8cb3b326-0c82-4361-94bf-76521ce7f95a tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:04:19.353725 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-8cb3b326-0c82-4361-94bf-76521ce7f95a tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] [instance: 8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:04:19.360714 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-8cb3b326-0c82-4361-94bf-76521ce7f95a tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:19.362166 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-8cb3b326-0c82-4361-94bf-76521ce7f95a tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:19.363544 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-8cb3b326-0c82-4361-94bf-76521ce7f95a tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:19.363980 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-8cb3b326-0c82-4361-94bf-76521ce7f95a tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:19.506974 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-8cb3b326-0c82-4361-94bf-76521ce7f95a tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '243e592fbf1844d89f55dd5035a684f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60447df5461141e883d207e028b74bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:04:19.515051 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-8cb3b326-0c82-4361-94bf-76521ce7f95a tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] 10.222.0.17 "GET /compute/v2.1/servers/8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8" status: 200 len: 1735 microversion: 2.1 time: 0.166563 Jun 16 23:04:19.515699 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 239/473] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:04:19 2022] GET /compute/v2.1/servers/8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8 => generated 1735 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 23:04:19.964006 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-9a13539b-ac34-4aea-b322-0bd5735fe2fb tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 23:04:19.971599 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-9a13539b-ac34-4aea-b322-0bd5735fe2fb tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:19.972056 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-9a13539b-ac34-4aea-b322-0bd5735fe2fb tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:20.030120 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-9a13539b-ac34-4aea-b322-0bd5735fe2fb tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] [instance: f4c73822-1dfa-4eed-bf02-1123b0402755] Going to try to stop instance {{(pid=117563) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 16 23:04:20.071916 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-9a13539b-ac34-4aea-b322-0bd5735fe2fb tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] 10.222.0.17 "POST /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755/action" status: 202 len: 0 microversion: 2.1 time: 0.111611 Jun 16 23:04:20.072516 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 235/474] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Jun 16 23:04:19 2022] POST /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755/action => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 23:04:20.080700 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-31c554fe-65c8-46b9-a9bc-4e633edee971 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:04:20.081314 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-31c554fe-65c8-46b9-a9bc-4e633edee971 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] [instance: f4c73822-1dfa-4eed-bf02-1123b0402755] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:04:20.087335 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-31c554fe-65c8-46b9-a9bc-4e633edee971 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:20.087801 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-31c554fe-65c8-46b9-a9bc-4e633edee971 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:20.088568 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-31c554fe-65c8-46b9-a9bc-4e633edee971 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:20.089013 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-31c554fe-65c8-46b9-a9bc-4e633edee971 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:20.220901 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-31c554fe-65c8-46b9-a9bc-4e633edee971 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a993f5d14b64fccad723abecfcadf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b1be8431b0434d8bd6abca293127d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:04:20.228468 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-31c554fe-65c8-46b9-a9bc-4e633edee971 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] 10.222.0.17 "GET /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755" status: 200 len: 1677 microversion: 2.1 time: 0.151588 Jun 16 23:04:20.229209 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 240/475] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:04:20 2022] GET /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755 => generated 1677 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 23:04:20.369690 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-092dfbc9-3229-47b2-bf81-96bd900907b4 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:04:20.370381 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-092dfbc9-3229-47b2-bf81-96bd900907b4 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] [instance: 85395b04-657c-4595-83ca-b6a1635f6daa] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:04:20.376490 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-092dfbc9-3229-47b2-bf81-96bd900907b4 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:20.376944 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-092dfbc9-3229-47b2-bf81-96bd900907b4 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:20.377708 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-092dfbc9-3229-47b2-bf81-96bd900907b4 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:20.378145 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-092dfbc9-3229-47b2-bf81-96bd900907b4 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:20.440022 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-092dfbc9-3229-47b2-bf81-96bd900907b4 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69163c28aa75492aa01c70532bed15a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9761759a69724a21b0b9315a931b106f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:04:20.447518 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-092dfbc9-3229-47b2-bf81-96bd900907b4 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] 10.222.0.17 "GET /compute/v2.1/servers/85395b04-657c-4595-83ca-b6a1635f6daa" status: 200 len: 1279 microversion: 2.1 time: 0.082093 Jun 16 23:04:20.448079 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 236/476] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:04:20 2022] GET /compute/v2.1/servers/85395b04-657c-4595-83ca-b6a1635f6daa => generated 1279 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:04:20.534066 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-98f41032-6937-46db-bf7d-0be0ad2d8e61 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:04:20.534714 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-98f41032-6937-46db-bf7d-0be0ad2d8e61 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] [instance: 8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:04:20.541250 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-98f41032-6937-46db-bf7d-0be0ad2d8e61 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:20.542029 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-98f41032-6937-46db-bf7d-0be0ad2d8e61 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:20.542867 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-98f41032-6937-46db-bf7d-0be0ad2d8e61 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:20.543313 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-98f41032-6937-46db-bf7d-0be0ad2d8e61 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:20.676855 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-98f41032-6937-46db-bf7d-0be0ad2d8e61 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '243e592fbf1844d89f55dd5035a684f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60447df5461141e883d207e028b74bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:04:20.684875 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-98f41032-6937-46db-bf7d-0be0ad2d8e61 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] 10.222.0.17 "GET /compute/v2.1/servers/8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8" status: 200 len: 1735 microversion: 2.1 time: 0.155817 Jun 16 23:04:20.685485 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 241/477] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:04:20 2022] GET /compute/v2.1/servers/8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8 => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:04:21.245924 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-4e97be25-5491-4dfa-ae0c-3372d36275ab tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:04:21.246529 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-4e97be25-5491-4dfa-ae0c-3372d36275ab tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] [instance: f4c73822-1dfa-4eed-bf02-1123b0402755] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:04:21.253533 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-4e97be25-5491-4dfa-ae0c-3372d36275ab tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:21.253977 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-4e97be25-5491-4dfa-ae0c-3372d36275ab tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:21.254937 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-4e97be25-5491-4dfa-ae0c-3372d36275ab tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:21.255371 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-4e97be25-5491-4dfa-ae0c-3372d36275ab tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:21.389516 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-4e97be25-5491-4dfa-ae0c-3372d36275ab tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a993f5d14b64fccad723abecfcadf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b1be8431b0434d8bd6abca293127d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:04:21.397293 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-4e97be25-5491-4dfa-ae0c-3372d36275ab tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] 10.222.0.17 "GET /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755" status: 200 len: 1677 microversion: 2.1 time: 0.155196 Jun 16 23:04:21.397851 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 237/478] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:04:21 2022] GET /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755 => generated 1677 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:04:21.463543 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-2fc1837b-0e2b-4c96-a6a0-1ee5443f708a tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:04:21.464239 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-2fc1837b-0e2b-4c96-a6a0-1ee5443f708a tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] [instance: 85395b04-657c-4595-83ca-b6a1635f6daa] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:04:21.470937 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-2fc1837b-0e2b-4c96-a6a0-1ee5443f708a tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:21.471391 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-2fc1837b-0e2b-4c96-a6a0-1ee5443f708a tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:21.472162 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-2fc1837b-0e2b-4c96-a6a0-1ee5443f708a tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:21.472597 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-2fc1837b-0e2b-4c96-a6a0-1ee5443f708a tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:21.568289 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [req-fa3dc15d-6f14-4978-85b7-89908d9f1318 req-7fa1dfe7-d611-46f3-86d5-fd53012f63c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85395b04-657c-4595-83ca-b6a1635f6daa", "tag": "ac6a1a50-fbb7-4e39-a93a-0f04a2cdfe38"}]} {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 23:04:21.578428 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-fa3dc15d-6f14-4978-85b7-89908d9f1318 req-7fa1dfe7-d611-46f3-86d5-fd53012f63c9 service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:21.579257 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-fa3dc15d-6f14-4978-85b7-89908d9f1318 req-7fa1dfe7-d611-46f3-86d5-fd53012f63c9 service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:21.607700 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-2fc1837b-0e2b-4c96-a6a0-1ee5443f708a tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69163c28aa75492aa01c70532bed15a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9761759a69724a21b0b9315a931b106f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:04:21.608940 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.compute.server_external_events [req-fa3dc15d-6f14-4978-85b7-89908d9f1318 req-7fa1dfe7-d611-46f3-86d5-fd53012f63c9 service nova] Creating event network-changed:ac6a1a50-fbb7-4e39-a93a-0f04a2cdfe38 for instance 85395b04-657c-4595-83ca-b6a1635f6daa on hv-cinder-84623 Jun 16 23:04:21.614536 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [req-fa3dc15d-6f14-4978-85b7-89908d9f1318 req-7fa1dfe7-d611-46f3-86d5-fd53012f63c9 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050038 Jun 16 23:04:21.615378 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 238/479] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 23:04:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 23:04:21.616102 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-2fc1837b-0e2b-4c96-a6a0-1ee5443f708a tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] 10.222.0.17 "GET /compute/v2.1/servers/85395b04-657c-4595-83ca-b6a1635f6daa" status: 200 len: 1319 microversion: 2.1 time: 0.156445 Jun 16 23:04:21.616660 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 242/480] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:04:21 2022] GET /compute/v2.1/servers/85395b04-657c-4595-83ca-b6a1635f6daa => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:04:21.701769 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-4e7b6ff0-ed69-4be4-98c9-9c971a9b7b80 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:04:21.702466 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-4e7b6ff0-ed69-4be4-98c9-9c971a9b7b80 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] [instance: 8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:04:21.709000 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-4e7b6ff0-ed69-4be4-98c9-9c971a9b7b80 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:21.709455 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-4e7b6ff0-ed69-4be4-98c9-9c971a9b7b80 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:21.710220 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-4e7b6ff0-ed69-4be4-98c9-9c971a9b7b80 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:21.710725 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-4e7b6ff0-ed69-4be4-98c9-9c971a9b7b80 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:21.839389 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-4e7b6ff0-ed69-4be4-98c9-9c971a9b7b80 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '243e592fbf1844d89f55dd5035a684f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60447df5461141e883d207e028b74bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:04:21.847672 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-4e7b6ff0-ed69-4be4-98c9-9c971a9b7b80 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] 10.222.0.17 "GET /compute/v2.1/servers/8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8" status: 200 len: 1735 microversion: 2.1 time: 0.150140 Jun 16 23:04:21.848226 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 239/481] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:04:21 2022] GET /compute/v2.1/servers/8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:04:22.414380 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-75a3bddc-b311-4e2d-8c84-c57b1ed62c5c tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:04:22.415005 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-75a3bddc-b311-4e2d-8c84-c57b1ed62c5c tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] [instance: f4c73822-1dfa-4eed-bf02-1123b0402755] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:04:22.420990 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-75a3bddc-b311-4e2d-8c84-c57b1ed62c5c tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:22.421444 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-75a3bddc-b311-4e2d-8c84-c57b1ed62c5c tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:22.422199 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-75a3bddc-b311-4e2d-8c84-c57b1ed62c5c tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:22.422659 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-75a3bddc-b311-4e2d-8c84-c57b1ed62c5c tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:22.546261 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-75a3bddc-b311-4e2d-8c84-c57b1ed62c5c tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a993f5d14b64fccad723abecfcadf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b1be8431b0434d8bd6abca293127d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:04:22.553633 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-75a3bddc-b311-4e2d-8c84-c57b1ed62c5c tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] 10.222.0.17 "GET /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755" status: 200 len: 1677 microversion: 2.1 time: 0.143133 Jun 16 23:04:22.554181 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 243/482] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:04:22 2022] GET /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755 => generated 1677 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:04:22.632846 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-5f92b2b7-6162-4704-863d-e2bdb676f874 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:04:22.633452 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-5f92b2b7-6162-4704-863d-e2bdb676f874 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] [instance: 85395b04-657c-4595-83ca-b6a1635f6daa] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:04:22.640593 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-5f92b2b7-6162-4704-863d-e2bdb676f874 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:22.641071 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-5f92b2b7-6162-4704-863d-e2bdb676f874 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:22.641829 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-5f92b2b7-6162-4704-863d-e2bdb676f874 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:22.642265 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-5f92b2b7-6162-4704-863d-e2bdb676f874 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:22.771721 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-5f92b2b7-6162-4704-863d-e2bdb676f874 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69163c28aa75492aa01c70532bed15a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9761759a69724a21b0b9315a931b106f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:04:22.779271 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-5f92b2b7-6162-4704-863d-e2bdb676f874 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] 10.222.0.17 "GET /compute/v2.1/servers/85395b04-657c-4595-83ca-b6a1635f6daa" status: 200 len: 1319 microversion: 2.1 time: 0.150299 Jun 16 23:04:22.779826 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 240/483] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:04:22 2022] GET /compute/v2.1/servers/85395b04-657c-4595-83ca-b6a1635f6daa => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:04:22.864811 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-97d4e791-8caa-4a71-a783-e80071ec6093 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:04:22.865423 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-97d4e791-8caa-4a71-a783-e80071ec6093 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] [instance: 8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:04:22.871600 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-97d4e791-8caa-4a71-a783-e80071ec6093 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:22.872055 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-97d4e791-8caa-4a71-a783-e80071ec6093 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:22.873452 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-97d4e791-8caa-4a71-a783-e80071ec6093 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:22.873896 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-97d4e791-8caa-4a71-a783-e80071ec6093 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:22.997212 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-97d4e791-8caa-4a71-a783-e80071ec6093 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '243e592fbf1844d89f55dd5035a684f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60447df5461141e883d207e028b74bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:04:23.005525 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-97d4e791-8caa-4a71-a783-e80071ec6093 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] 10.222.0.17 "GET /compute/v2.1/servers/8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8" status: 200 len: 1735 microversion: 2.1 time: 0.144576 Jun 16 23:04:23.006071 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 244/484] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:04:22 2022] GET /compute/v2.1/servers/8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8 => generated 1735 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:04:23.570981 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-9aea5d0c-48b2-48c0-a163-ad3e506e6fb0 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:04:23.571582 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-9aea5d0c-48b2-48c0-a163-ad3e506e6fb0 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] [instance: f4c73822-1dfa-4eed-bf02-1123b0402755] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:04:23.577584 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-9aea5d0c-48b2-48c0-a163-ad3e506e6fb0 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:23.578028 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-9aea5d0c-48b2-48c0-a163-ad3e506e6fb0 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:23.578810 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-9aea5d0c-48b2-48c0-a163-ad3e506e6fb0 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:23.579245 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-9aea5d0c-48b2-48c0-a163-ad3e506e6fb0 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:23.583329 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG dbcounter [-] [117563] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=117563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 23:04:23.721936 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-9aea5d0c-48b2-48c0-a163-ad3e506e6fb0 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a993f5d14b64fccad723abecfcadf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b1be8431b0434d8bd6abca293127d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:04:23.729392 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-9aea5d0c-48b2-48c0-a163-ad3e506e6fb0 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] 10.222.0.17 "GET /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755" status: 200 len: 1677 microversion: 2.1 time: 0.162228 Jun 16 23:04:23.729981 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 241/485] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:04:23 2022] GET /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755 => generated 1677 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:04:23.796221 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-d4467fa7-57df-47f9-a561-d7d6963e64db tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:04:23.796831 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-d4467fa7-57df-47f9-a561-d7d6963e64db tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] [instance: 85395b04-657c-4595-83ca-b6a1635f6daa] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:04:23.803256 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-d4467fa7-57df-47f9-a561-d7d6963e64db tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:23.803699 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-d4467fa7-57df-47f9-a561-d7d6963e64db tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:23.804458 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-d4467fa7-57df-47f9-a561-d7d6963e64db tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:23.804891 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-d4467fa7-57df-47f9-a561-d7d6963e64db tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:23.932309 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-d4467fa7-57df-47f9-a561-d7d6963e64db tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69163c28aa75492aa01c70532bed15a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9761759a69724a21b0b9315a931b106f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:04:23.939703 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-d4467fa7-57df-47f9-a561-d7d6963e64db tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] 10.222.0.17 "GET /compute/v2.1/servers/85395b04-657c-4595-83ca-b6a1635f6daa" status: 200 len: 1319 microversion: 2.1 time: 0.147939 Jun 16 23:04:23.940252 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 245/486] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:04:23 2022] GET /compute/v2.1/servers/85395b04-657c-4595-83ca-b6a1635f6daa => generated 1319 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:04:24.022210 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-caff0360-56ef-4570-aa76-5a9143d79458 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:04:24.022957 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-caff0360-56ef-4570-aa76-5a9143d79458 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] [instance: 8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:04:24.028952 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-caff0360-56ef-4570-aa76-5a9143d79458 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:24.029397 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-caff0360-56ef-4570-aa76-5a9143d79458 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:24.030149 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-caff0360-56ef-4570-aa76-5a9143d79458 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:24.030579 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-caff0360-56ef-4570-aa76-5a9143d79458 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:24.158178 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-caff0360-56ef-4570-aa76-5a9143d79458 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '243e592fbf1844d89f55dd5035a684f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60447df5461141e883d207e028b74bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:04:24.166112 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-caff0360-56ef-4570-aa76-5a9143d79458 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] 10.222.0.17 "GET /compute/v2.1/servers/8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8" status: 200 len: 1735 microversion: 2.1 time: 0.147891 Jun 16 23:04:24.166685 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 242/487] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:04:24 2022] GET /compute/v2.1/servers/8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8 => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:04:24.747665 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-bd92b345-8f3d-45e4-ace3-5a7b4defdd00 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:04:24.748268 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-bd92b345-8f3d-45e4-ace3-5a7b4defdd00 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] [instance: f4c73822-1dfa-4eed-bf02-1123b0402755] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:04:24.750188 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG dbcounter [-] [117562] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=3 {{(pid=117562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 23:04:24.755629 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-bd92b345-8f3d-45e4-ace3-5a7b4defdd00 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:24.756180 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-bd92b345-8f3d-45e4-ace3-5a7b4defdd00 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:24.756953 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-bd92b345-8f3d-45e4-ace3-5a7b4defdd00 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:24.757388 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-bd92b345-8f3d-45e4-ace3-5a7b4defdd00 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:24.886199 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-bd92b345-8f3d-45e4-ace3-5a7b4defdd00 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a993f5d14b64fccad723abecfcadf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b1be8431b0434d8bd6abca293127d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:04:24.894078 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-bd92b345-8f3d-45e4-ace3-5a7b4defdd00 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] 10.222.0.17 "GET /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755" status: 200 len: 1677 microversion: 2.1 time: 0.150413 Jun 16 23:04:24.894652 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 246/488] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:04:24 2022] GET /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755 => generated 1677 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:04:24.956659 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-035e8e70-ed2b-4521-ae18-32945a71b7d9 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:04:24.957256 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-035e8e70-ed2b-4521-ae18-32945a71b7d9 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] [instance: 85395b04-657c-4595-83ca-b6a1635f6daa] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:04:24.963696 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-035e8e70-ed2b-4521-ae18-32945a71b7d9 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:24.964138 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-035e8e70-ed2b-4521-ae18-32945a71b7d9 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:24.964891 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-035e8e70-ed2b-4521-ae18-32945a71b7d9 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:24.965333 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-035e8e70-ed2b-4521-ae18-32945a71b7d9 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:25.089723 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-035e8e70-ed2b-4521-ae18-32945a71b7d9 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69163c28aa75492aa01c70532bed15a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9761759a69724a21b0b9315a931b106f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:04:25.097264 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-035e8e70-ed2b-4521-ae18-32945a71b7d9 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] 10.222.0.17 "GET /compute/v2.1/servers/85395b04-657c-4595-83ca-b6a1635f6daa" status: 200 len: 1319 microversion: 2.1 time: 0.144354 Jun 16 23:04:25.097817 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 243/489] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:04:24 2022] GET /compute/v2.1/servers/85395b04-657c-4595-83ca-b6a1635f6daa => generated 1319 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:04:25.183419 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-7a0a9e70-78a5-43b6-b42f-2e4eedd496e7 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:04:25.184026 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-7a0a9e70-78a5-43b6-b42f-2e4eedd496e7 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] [instance: 8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:04:25.190419 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-7a0a9e70-78a5-43b6-b42f-2e4eedd496e7 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:25.190910 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-7a0a9e70-78a5-43b6-b42f-2e4eedd496e7 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:25.191678 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-7a0a9e70-78a5-43b6-b42f-2e4eedd496e7 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:25.192117 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-7a0a9e70-78a5-43b6-b42f-2e4eedd496e7 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:25.324212 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-7a0a9e70-78a5-43b6-b42f-2e4eedd496e7 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '243e592fbf1844d89f55dd5035a684f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60447df5461141e883d207e028b74bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:04:25.332864 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-7a0a9e70-78a5-43b6-b42f-2e4eedd496e7 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] 10.222.0.17 "GET /compute/v2.1/servers/8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8" status: 200 len: 1735 microversion: 2.1 time: 0.153254 Jun 16 23:04:25.333416 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 247/490] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:04:25 2022] GET /compute/v2.1/servers/8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8 => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:04:25.911976 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-2433ae01-b971-4db8-b652-717fdb42805f tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:04:25.912574 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-2433ae01-b971-4db8-b652-717fdb42805f tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] [instance: f4c73822-1dfa-4eed-bf02-1123b0402755] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:04:25.918733 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-2433ae01-b971-4db8-b652-717fdb42805f tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:25.919747 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-2433ae01-b971-4db8-b652-717fdb42805f tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:25.920497 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-2433ae01-b971-4db8-b652-717fdb42805f tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:25.920931 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-2433ae01-b971-4db8-b652-717fdb42805f tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:26.049224 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-2433ae01-b971-4db8-b652-717fdb42805f tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a993f5d14b64fccad723abecfcadf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b1be8431b0434d8bd6abca293127d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:04:26.059681 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-2433ae01-b971-4db8-b652-717fdb42805f tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] 10.222.0.17 "GET /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755" status: 200 len: 1677 microversion: 2.1 time: 0.150991 Jun 16 23:04:26.060138 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 244/491] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:04:25 2022] GET /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755 => generated 1677 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:04:26.113570 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-4ae31a4a-19b2-4082-b2db-23220357be0d tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:04:26.114177 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-4ae31a4a-19b2-4082-b2db-23220357be0d tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] [instance: 85395b04-657c-4595-83ca-b6a1635f6daa] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:04:26.120648 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-4ae31a4a-19b2-4082-b2db-23220357be0d tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:26.121097 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-4ae31a4a-19b2-4082-b2db-23220357be0d tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:26.121861 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-4ae31a4a-19b2-4082-b2db-23220357be0d tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:26.122352 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-4ae31a4a-19b2-4082-b2db-23220357be0d tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:26.251544 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-4ae31a4a-19b2-4082-b2db-23220357be0d tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69163c28aa75492aa01c70532bed15a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9761759a69724a21b0b9315a931b106f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:04:26.258947 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-4ae31a4a-19b2-4082-b2db-23220357be0d tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] 10.222.0.17 "GET /compute/v2.1/servers/85395b04-657c-4595-83ca-b6a1635f6daa" status: 200 len: 1319 microversion: 2.1 time: 0.149107 Jun 16 23:04:26.259514 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 248/492] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:04:26 2022] GET /compute/v2.1/servers/85395b04-657c-4595-83ca-b6a1635f6daa => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:04:26.349045 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-2d6b32d4-53d5-4bca-bc13-e2ac4696dbce tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:04:26.349647 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-2d6b32d4-53d5-4bca-bc13-e2ac4696dbce tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] [instance: 8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:04:26.355638 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-2d6b32d4-53d5-4bca-bc13-e2ac4696dbce tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:26.356088 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-2d6b32d4-53d5-4bca-bc13-e2ac4696dbce tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:26.356885 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-2d6b32d4-53d5-4bca-bc13-e2ac4696dbce tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:26.357321 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-2d6b32d4-53d5-4bca-bc13-e2ac4696dbce tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:26.485642 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-2d6b32d4-53d5-4bca-bc13-e2ac4696dbce tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '243e592fbf1844d89f55dd5035a684f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60447df5461141e883d207e028b74bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:04:26.493588 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-2d6b32d4-53d5-4bca-bc13-e2ac4696dbce tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] 10.222.0.17 "GET /compute/v2.1/servers/8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8" status: 200 len: 1735 microversion: 2.1 time: 0.148320 Jun 16 23:04:26.494146 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 245/493] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:04:26 2022] GET /compute/v2.1/servers/8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8 => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:04:27.076900 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-1437752d-718c-4b61-8673-af8e201932fa tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:04:27.077437 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-1437752d-718c-4b61-8673-af8e201932fa tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] [instance: f4c73822-1dfa-4eed-bf02-1123b0402755] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:04:27.083444 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-1437752d-718c-4b61-8673-af8e201932fa tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:27.083890 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-1437752d-718c-4b61-8673-af8e201932fa tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:27.084646 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-1437752d-718c-4b61-8673-af8e201932fa tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:27.085078 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-1437752d-718c-4b61-8673-af8e201932fa tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:27.210618 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-1437752d-718c-4b61-8673-af8e201932fa tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a993f5d14b64fccad723abecfcadf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b1be8431b0434d8bd6abca293127d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:04:27.213953 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG dbcounter [-] [117562] Writing DB stats nova_cell1:SELECT=100 {{(pid=117562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 23:04:27.219793 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-1437752d-718c-4b61-8673-af8e201932fa tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] 10.222.0.17 "GET /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755" status: 200 len: 1677 microversion: 2.1 time: 0.146833 Jun 16 23:04:27.220390 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 249/494] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:04:27 2022] GET /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755 => generated 1677 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:04:27.275914 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-7d1cefe5-6305-4354-86e8-2f2c766fc6eb tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:04:27.276577 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-7d1cefe5-6305-4354-86e8-2f2c766fc6eb tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] [instance: 85395b04-657c-4595-83ca-b6a1635f6daa] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:04:27.283461 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-7d1cefe5-6305-4354-86e8-2f2c766fc6eb tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:27.283907 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-7d1cefe5-6305-4354-86e8-2f2c766fc6eb tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:27.284676 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-7d1cefe5-6305-4354-86e8-2f2c766fc6eb tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:27.285107 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-7d1cefe5-6305-4354-86e8-2f2c766fc6eb tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:27.417542 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-7d1cefe5-6305-4354-86e8-2f2c766fc6eb tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69163c28aa75492aa01c70532bed15a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9761759a69724a21b0b9315a931b106f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:04:27.425268 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-7d1cefe5-6305-4354-86e8-2f2c766fc6eb tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] 10.222.0.17 "GET /compute/v2.1/servers/85395b04-657c-4595-83ca-b6a1635f6daa" status: 200 len: 1319 microversion: 2.1 time: 0.153130 Jun 16 23:04:27.425826 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 246/495] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:04:27 2022] GET /compute/v2.1/servers/85395b04-657c-4595-83ca-b6a1635f6daa => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:04:27.510792 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-02f7cbfb-d776-43dc-b939-a6227f5a925d tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:04:27.511437 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-02f7cbfb-d776-43dc-b939-a6227f5a925d tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] [instance: 8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:04:27.518246 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-02f7cbfb-d776-43dc-b939-a6227f5a925d tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:27.518748 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-02f7cbfb-d776-43dc-b939-a6227f5a925d tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:27.519525 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-02f7cbfb-d776-43dc-b939-a6227f5a925d tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:27.519968 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-02f7cbfb-d776-43dc-b939-a6227f5a925d tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:27.567598 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-ac9f1fae-9bbf-45d9-b973-590536976fec tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:04:27.568092 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-ac9f1fae-9bbf-45d9-b973-590536976fec tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] [instance: 22fa37ae-2cac-42ad-9332-ab7da7c574d5] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:04:27.573962 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-ac9f1fae-9bbf-45d9-b973-590536976fec tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:27.574409 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-ac9f1fae-9bbf-45d9-b973-590536976fec tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:27.575807 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-ac9f1fae-9bbf-45d9-b973-590536976fec tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:27.576242 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-ac9f1fae-9bbf-45d9-b973-590536976fec tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:27.598691 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-ac9f1fae-9bbf-45d9-b973-590536976fec tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] 10.222.0.17 "GET /compute/v2.1/servers/22fa37ae-2cac-42ad-9332-ab7da7c574d5/ips" status: 200 len: 149 microversion: 2.1 time: 0.034842 Jun 16 23:04:27.599276 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 247/496] 10.222.0.17 () {58 vars in 1247 bytes} [Thu Jun 16 23:04:27 2022] GET /compute/v2.1/servers/22fa37ae-2cac-42ad-9332-ab7da7c574d5/ips => generated 149 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 23:04:27.609587 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-6510623c-f1a5-4201-811d-b105d65985e9 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2206e81b-0e64-49bd-bc05-08fb12cab02d"}} {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 23:04:27.610742 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-6510623c-f1a5-4201-811d-b105d65985e9 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] [instance: 22fa37ae-2cac-42ad-9332-ab7da7c574d5] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:04:27.616875 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-6510623c-f1a5-4201-811d-b105d65985e9 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:27.617266 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-6510623c-f1a5-4201-811d-b105d65985e9 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:27.618027 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-6510623c-f1a5-4201-811d-b105d65985e9 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:27.618461 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-6510623c-f1a5-4201-811d-b105d65985e9 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:27.649952 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-02f7cbfb-d776-43dc-b939-a6227f5a925d tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '243e592fbf1844d89f55dd5035a684f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60447df5461141e883d207e028b74bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:04:27.657935 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-02f7cbfb-d776-43dc-b939-a6227f5a925d tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] 10.222.0.17 "GET /compute/v2.1/servers/8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8" status: 200 len: 1735 microversion: 2.1 time: 0.151025 Jun 16 23:04:27.658491 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 250/497] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:04:27 2022] GET /compute/v2.1/servers/8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8 => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:04:27.696062 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.wsgi [None req-6510623c-f1a5-4201-811d-b105d65985e9 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] HTTP exception thrown: Invalid volume: volume 2206e81b-0e64-49bd-bc05-08fb12cab02d is already attached to instances: 5cfd118b-cc42-4dbe-93f1-784454892318 Jun 16 23:04:27.697772 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-6510623c-f1a5-4201-811d-b105d65985e9 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Request method failure captured: Jun 16 23:04:27.697772 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: request: POST /compute/v2.1/servers/22fa37ae-2cac-42ad-9332-ab7da7c574d5/os-volume_attachments HTTP/1.1 Jun 16 23:04:27.697772 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Accept: application/json Jun 16 23:04:27.697772 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Accept-Encoding: identity Jun 16 23:04:27.697772 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Connection: close Jun 16 23:04:27.697772 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Content-Length: 74 Jun 16 23:04:27.697772 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Content-Type: application/json Jun 16 23:04:27.697772 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Host: 10.222.0.17 Jun 16 23:04:27.697772 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Openstack-System-Scope: None Jun 16 23:04:27.697772 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: User-Agent: python-urllib3/1.26.9 Jun 16 23:04:27.697772 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Auth-Token: gAAAAABiq7YeRQnlz8l2GSIF0VOET6Y1W8yBB5oz1cYYpYFcfT7cYY0kIvo4O2qRVrDvagXVbkghr-k-KGb8GCGo_mbQOK1vAXciruDemULKCP_QAI9xPZafRW81TxgAIAvJEx6CPJUGbCIq4SyYsx25OB1SZXBFh8aRZWpbG6CQ65KEZvQlgIo Jun 16 23:04:27.697772 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Domain-Id: None Jun 16 23:04:27.697772 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Domain-Name: None Jun 16 23:04:27.697772 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Identity-Status: Confirmed Jun 16 23:04:27.697772 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Is-Admin-Project: True Jun 16 23:04:27.697772 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Project-Domain-Id: default Jun 16 23:04:27.697772 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Project-Domain-Name: Default Jun 16 23:04:27.697772 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Project-Id: 0526c12e8bc947209e24daf5ddfad7be Jun 16 23:04:27.697772 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Project-Name: tempest-AttachVolumeNegativeTest-1967724585 Jun 16 23:04:27.697772 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Role: member,reader Jun 16 23:04:27.697772 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Roles: member,reader Jun 16 23:04:27.699376 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/0526c12e8bc947209e24daf5ddfad7be"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_0526c12e8bc947209e24daf5ddfad7be"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0526c12e8bc947209e24daf5ddfad7be"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0526c12e8bc947209e24daf5ddfad7be"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Jun 16 23:04:27.699376 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Tenant: tempest-AttachVolumeNegativeTest-1967724585 Jun 16 23:04:27.699376 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Tenant-Id: 0526c12e8bc947209e24daf5ddfad7be Jun 16 23:04:27.699376 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1967724585 Jun 16 23:04:27.699376 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-User: tempest-AttachVolumeNegativeTest-1967724585-project Jun 16 23:04:27.699376 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-User-Domain-Id: default Jun 16 23:04:27.699376 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-User-Domain-Name: Default Jun 16 23:04:27.699376 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-User-Id: 9e3a2d16133b4af8a208682de8a7d111 Jun 16 23:04:27.699376 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-User-Name: tempest-AttachVolumeNegativeTest-1967724585-project Jun 16 23:04:27.699376 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Jun 16 23:04:27.699376 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: {"volumeAttachment": {"volumeId": "2206e81b-0e64-49bd-bc05-08fb12cab02d"}} Jun 16 23:04:27.699376 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: method: > Jun 16 23:04:27.700312 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: exception: Invalid volume: volume 2206e81b-0e64-49bd-bc05-08fb12cab02d is already attached to instances: 5cfd118b-cc42-4dbe-93f1-784454892318 Jun 16 23:04:27.700312 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: action_args: {'server_id': '22fa37ae-2cac-42ad-9332-ab7da7c574d5', 'body': {'volumeAttachment': {'volumeId': '2206e81b-0e64-49bd-bc05-08fb12cab02d'}}} Jun 16 23:04:27.700312 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 23:04:27.700312 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 23:04:27.700312 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 16 23:04:27.700312 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 16 23:04:27.700312 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 16 23:04:27.700312 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 16 23:04:27.700312 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 16 23:04:27.700312 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 16 23:04:27.700312 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 16 23:04:27.700312 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 16 23:04:27.700312 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 16 23:04:27.700312 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 16 23:04:27.700312 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 2206e81b-0e64-49bd-bc05-08fb12cab02d is already attached to instances: 5cfd118b-cc42-4dbe-93f1-784454892318 Jun 16 23:04:27.700312 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 16 23:04:27.700312 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 23:04:27.700312 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 16 23:04:27.700312 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 23:04:27.701648 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 23:04:27.701648 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 23:04:27.701648 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 23:04:27.701648 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 23:04:27.701648 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 23:04:27.701648 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 23:04:27.701648 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 23:04:27.701648 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 23:04:27.701648 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 23:04:27.701648 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 23:04:27.701648 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 23:04:27.701648 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 23:04:27.701648 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 16 23:04:27.701648 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 16 23:04:27.701648 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 2206e81b-0e64-49bd-bc05-08fb12cab02d is already attached to instances: 5cfd118b-cc42-4dbe-93f1-784454892318 Jun 16 23:04:27.701648 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 16 23:04:27.701648 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 23:04:27.701648 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 16 23:04:27.701648 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 23:04:27.701648 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 23:04:27.703468 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 23:04:27.703468 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 23:04:27.703468 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 23:04:27.703468 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 2206e81b-0e64-49bd-bc05-08fb12cab02d is already attached to instances: 5cfd118b-cc42-4dbe-93f1-784454892318 Jun 16 23:04:27.703468 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 16 23:04:27.703468 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-6510623c-f1a5-4201-811d-b105d65985e9 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Returning 400 to user: Invalid volume: volume 2206e81b-0e64-49bd-bc05-08fb12cab02d is already attached to instances: 5cfd118b-cc42-4dbe-93f1-784454892318 {{(pid=117563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 23:04:27.703468 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-6510623c-f1a5-4201-811d-b105d65985e9 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] 10.222.0.17 "POST /compute/v2.1/servers/22fa37ae-2cac-42ad-9332-ab7da7c574d5/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.093796 Jun 16 23:04:27.703468 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 248/498] 10.222.0.17 () {60 vars in 1322 bytes} [Thu Jun 16 23:04:27 2022] POST /compute/v2.1/servers/22fa37ae-2cac-42ad-9332-ab7da7c574d5/os-volume_attachments => generated 174 bytes in 95 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 16 23:04:27.707944 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-38012278-38b5-4aaa-a498-1241224bd585 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:04:27.708446 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-38012278-38b5-4aaa-a498-1241224bd585 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] [instance: 22fa37ae-2cac-42ad-9332-ab7da7c574d5] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:04:27.714393 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-38012278-38b5-4aaa-a498-1241224bd585 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:27.714887 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-38012278-38b5-4aaa-a498-1241224bd585 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:27.715913 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-38012278-38b5-4aaa-a498-1241224bd585 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:27.716400 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-38012278-38b5-4aaa-a498-1241224bd585 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:27.748453 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-38012278-38b5-4aaa-a498-1241224bd585 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] [instance: 22fa37ae-2cac-42ad-9332-ab7da7c574d5] Going to try to terminate instance {{(pid=117562) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 23:04:27.835044 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-38012278-38b5-4aaa-a498-1241224bd585 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] 10.222.0.17 "DELETE /compute/v2.1/servers/22fa37ae-2cac-42ad-9332-ab7da7c574d5" status: 204 len: 0 microversion: 2.1 time: 0.130635 Jun 16 23:04:27.835625 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 251/499] 10.222.0.17 () {58 vars in 1238 bytes} [Thu Jun 16 23:04:27 2022] DELETE /compute/v2.1/servers/22fa37ae-2cac-42ad-9332-ab7da7c574d5 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 16 23:04:27.849470 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-2591afe1-bfe3-43d2-a975-b5e2cdbc9c6f tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:04:27.850221 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-2591afe1-bfe3-43d2-a975-b5e2cdbc9c6f tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] [instance: 22fa37ae-2cac-42ad-9332-ab7da7c574d5] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:04:27.857744 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-2591afe1-bfe3-43d2-a975-b5e2cdbc9c6f tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:27.858198 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-2591afe1-bfe3-43d2-a975-b5e2cdbc9c6f tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:27.859002 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-2591afe1-bfe3-43d2-a975-b5e2cdbc9c6f tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:27.859451 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-2591afe1-bfe3-43d2-a975-b5e2cdbc9c6f tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:27.991065 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-2591afe1-bfe3-43d2-a975-b5e2cdbc9c6f tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3a2d16133b4af8a208682de8a7d111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0526c12e8bc947209e24daf5ddfad7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:04:27.998471 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-2591afe1-bfe3-43d2-a975-b5e2cdbc9c6f tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] 10.222.0.17 "GET /compute/v2.1/servers/22fa37ae-2cac-42ad-9332-ab7da7c574d5" status: 200 len: 1681 microversion: 2.1 time: 0.155377 Jun 16 23:04:27.999049 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 249/500] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:04:27 2022] GET /compute/v2.1/servers/22fa37ae-2cac-42ad-9332-ab7da7c574d5 => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:04:28.237748 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-a9f72f3b-6348-474a-a88d-f8f244b963f3 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:04:28.238440 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-a9f72f3b-6348-474a-a88d-f8f244b963f3 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] [instance: f4c73822-1dfa-4eed-bf02-1123b0402755] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:04:28.244834 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-a9f72f3b-6348-474a-a88d-f8f244b963f3 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:28.245285 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-a9f72f3b-6348-474a-a88d-f8f244b963f3 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:28.246038 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-a9f72f3b-6348-474a-a88d-f8f244b963f3 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:28.246470 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-a9f72f3b-6348-474a-a88d-f8f244b963f3 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:28.374767 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-a9f72f3b-6348-474a-a88d-f8f244b963f3 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a993f5d14b64fccad723abecfcadf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b1be8431b0434d8bd6abca293127d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:04:28.382255 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-a9f72f3b-6348-474a-a88d-f8f244b963f3 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] 10.222.0.17 "GET /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755" status: 200 len: 1677 microversion: 2.1 time: 0.148658 Jun 16 23:04:28.382838 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 252/501] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:04:28 2022] GET /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755 => generated 1677 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:04:28.442619 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-8cf0c0f8-5d91-4964-b195-d06ab5413553 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:04:28.443218 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-8cf0c0f8-5d91-4964-b195-d06ab5413553 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] [instance: 85395b04-657c-4595-83ca-b6a1635f6daa] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:04:28.449579 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-8cf0c0f8-5d91-4964-b195-d06ab5413553 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:28.450607 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-8cf0c0f8-5d91-4964-b195-d06ab5413553 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:28.451374 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-8cf0c0f8-5d91-4964-b195-d06ab5413553 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:28.451833 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-8cf0c0f8-5d91-4964-b195-d06ab5413553 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:28.574105 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-8cf0c0f8-5d91-4964-b195-d06ab5413553 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69163c28aa75492aa01c70532bed15a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9761759a69724a21b0b9315a931b106f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:04:28.581986 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-8cf0c0f8-5d91-4964-b195-d06ab5413553 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] 10.222.0.17 "GET /compute/v2.1/servers/85395b04-657c-4595-83ca-b6a1635f6daa" status: 200 len: 1319 microversion: 2.1 time: 0.143226 Jun 16 23:04:28.582547 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 250/502] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:04:28 2022] GET /compute/v2.1/servers/85395b04-657c-4595-83ca-b6a1635f6daa => generated 1319 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:04:28.674619 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-04fcc69d-f851-4d03-a488-af531e758275 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:04:28.675225 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-04fcc69d-f851-4d03-a488-af531e758275 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] [instance: 8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:04:28.681118 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-04fcc69d-f851-4d03-a488-af531e758275 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:28.681564 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-04fcc69d-f851-4d03-a488-af531e758275 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:28.682318 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-04fcc69d-f851-4d03-a488-af531e758275 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:28.682788 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-04fcc69d-f851-4d03-a488-af531e758275 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:28.811292 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-04fcc69d-f851-4d03-a488-af531e758275 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '243e592fbf1844d89f55dd5035a684f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60447df5461141e883d207e028b74bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:04:28.819650 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-04fcc69d-f851-4d03-a488-af531e758275 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] 10.222.0.17 "GET /compute/v2.1/servers/8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8" status: 200 len: 1735 microversion: 2.1 time: 0.148710 Jun 16 23:04:28.820414 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 253/503] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:04:28 2022] GET /compute/v2.1/servers/8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:04:28.937464 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [req-d008d7b5-5ce1-431b-b39a-d32cfc1b13fd req-a391a51e-6d17-4ea7-b4b0-1f91aa26811a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85395b04-657c-4595-83ca-b6a1635f6daa", "name": "network-vif-plugged", "status": "completed", "tag": "ac6a1a50-fbb7-4e39-a93a-0f04a2cdfe38"}]} {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 23:04:28.946274 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-d008d7b5-5ce1-431b-b39a-d32cfc1b13fd req-a391a51e-6d17-4ea7-b4b0-1f91aa26811a service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:28.947479 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-d008d7b5-5ce1-431b-b39a-d32cfc1b13fd req-a391a51e-6d17-4ea7-b4b0-1f91aa26811a service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:28.958910 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.compute.server_external_events [req-d008d7b5-5ce1-431b-b39a-d32cfc1b13fd req-a391a51e-6d17-4ea7-b4b0-1f91aa26811a service nova] Creating event network-vif-plugged:ac6a1a50-fbb7-4e39-a93a-0f04a2cdfe38 for instance 85395b04-657c-4595-83ca-b6a1635f6daa on hv-cinder-84623 Jun 16 23:04:28.963912 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [req-d008d7b5-5ce1-431b-b39a-d32cfc1b13fd req-a391a51e-6d17-4ea7-b4b0-1f91aa26811a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030614 Jun 16 23:04:28.964508 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 251/504] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 23:04:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 23:04:29.015755 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-b9d2b6af-6962-442f-8613-c8c3fa4580c0 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:04:29.016354 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-b9d2b6af-6962-442f-8613-c8c3fa4580c0 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] [instance: 22fa37ae-2cac-42ad-9332-ab7da7c574d5] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:04:29.023658 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-b9d2b6af-6962-442f-8613-c8c3fa4580c0 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:29.023658 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-b9d2b6af-6962-442f-8613-c8c3fa4580c0 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:29.023658 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-b9d2b6af-6962-442f-8613-c8c3fa4580c0 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:29.029792 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-b9d2b6af-6962-442f-8613-c8c3fa4580c0 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:29.160671 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-b9d2b6af-6962-442f-8613-c8c3fa4580c0 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3a2d16133b4af8a208682de8a7d111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0526c12e8bc947209e24daf5ddfad7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:04:29.170073 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-b9d2b6af-6962-442f-8613-c8c3fa4580c0 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] 10.222.0.17 "GET /compute/v2.1/servers/22fa37ae-2cac-42ad-9332-ab7da7c574d5" status: 200 len: 1681 microversion: 2.1 time: 0.158635 Jun 16 23:04:29.171011 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 254/505] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:04:29 2022] GET /compute/v2.1/servers/22fa37ae-2cac-42ad-9332-ab7da7c574d5 => generated 1681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:04:29.400671 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-631a87cf-a021-4562-a272-e5c303fc7802 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:04:29.401369 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-631a87cf-a021-4562-a272-e5c303fc7802 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] [instance: f4c73822-1dfa-4eed-bf02-1123b0402755] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:04:29.403378 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG dbcounter [-] [117563] Writing DB stats nova_cell0:SELECT=2 {{(pid=117563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 23:04:29.409349 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-631a87cf-a021-4562-a272-e5c303fc7802 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:29.409797 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-631a87cf-a021-4562-a272-e5c303fc7802 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:29.410828 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-631a87cf-a021-4562-a272-e5c303fc7802 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:29.411273 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-631a87cf-a021-4562-a272-e5c303fc7802 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:29.547009 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-631a87cf-a021-4562-a272-e5c303fc7802 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a993f5d14b64fccad723abecfcadf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b1be8431b0434d8bd6abca293127d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:04:29.554462 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-631a87cf-a021-4562-a272-e5c303fc7802 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] 10.222.0.17 "GET /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755" status: 200 len: 1677 microversion: 2.1 time: 0.158077 Jun 16 23:04:29.555061 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 252/506] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:04:29 2022] GET /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755 => generated 1677 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:04:29.598765 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-955330c6-9112-4f2b-b183-1fced36ff810 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:04:29.599375 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-955330c6-9112-4f2b-b183-1fced36ff810 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] [instance: 85395b04-657c-4595-83ca-b6a1635f6daa] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:04:29.601300 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG dbcounter [-] [117562] Writing DB stats nova_cell0:SELECT=2 {{(pid=117562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 23:04:29.601973 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG dbcounter [-] [117562] Writing DB stats nova_cell0:SELECT=6 {{(pid=117562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 23:04:29.608771 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-955330c6-9112-4f2b-b183-1fced36ff810 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:29.609222 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-955330c6-9112-4f2b-b183-1fced36ff810 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:29.609986 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-955330c6-9112-4f2b-b183-1fced36ff810 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:29.610422 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-955330c6-9112-4f2b-b183-1fced36ff810 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:29.736191 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-955330c6-9112-4f2b-b183-1fced36ff810 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69163c28aa75492aa01c70532bed15a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9761759a69724a21b0b9315a931b106f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:04:29.743537 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-955330c6-9112-4f2b-b183-1fced36ff810 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] 10.222.0.17 "GET /compute/v2.1/servers/85395b04-657c-4595-83ca-b6a1635f6daa" status: 200 len: 1319 microversion: 2.1 time: 0.148589 Jun 16 23:04:29.744097 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 255/507] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:04:29 2022] GET /compute/v2.1/servers/85395b04-657c-4595-83ca-b6a1635f6daa => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:04:29.837050 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-44a6cf64-9bda-4559-a9b5-55034ff7d795 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:04:29.837649 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-44a6cf64-9bda-4559-a9b5-55034ff7d795 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] [instance: 8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:04:29.844389 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-44a6cf64-9bda-4559-a9b5-55034ff7d795 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:29.844829 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-44a6cf64-9bda-4559-a9b5-55034ff7d795 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:29.845591 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-44a6cf64-9bda-4559-a9b5-55034ff7d795 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:29.846026 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-44a6cf64-9bda-4559-a9b5-55034ff7d795 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:29.975007 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-44a6cf64-9bda-4559-a9b5-55034ff7d795 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '243e592fbf1844d89f55dd5035a684f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60447df5461141e883d207e028b74bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:04:29.983314 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-44a6cf64-9bda-4559-a9b5-55034ff7d795 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] 10.222.0.17 "GET /compute/v2.1/servers/8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8" status: 200 len: 1735 microversion: 2.1 time: 0.150108 Jun 16 23:04:29.983997 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 253/508] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:04:29 2022] GET /compute/v2.1/servers/8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:04:30.188425 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-6942f6bd-a321-4080-adda-d423000b9b10 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:04:30.189035 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-6942f6bd-a321-4080-adda-d423000b9b10 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] [instance: 22fa37ae-2cac-42ad-9332-ab7da7c574d5] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:04:30.196014 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-6942f6bd-a321-4080-adda-d423000b9b10 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:30.196401 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-6942f6bd-a321-4080-adda-d423000b9b10 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:30.197217 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-6942f6bd-a321-4080-adda-d423000b9b10 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:30.197659 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-6942f6bd-a321-4080-adda-d423000b9b10 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:30.337972 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-6942f6bd-a321-4080-adda-d423000b9b10 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3a2d16133b4af8a208682de8a7d111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0526c12e8bc947209e24daf5ddfad7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:04:30.346265 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-6942f6bd-a321-4080-adda-d423000b9b10 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] 10.222.0.17 "GET /compute/v2.1/servers/22fa37ae-2cac-42ad-9332-ab7da7c574d5" status: 200 len: 1681 microversion: 2.1 time: 0.162328 Jun 16 23:04:30.346858 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 256/509] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:04:30 2022] GET /compute/v2.1/servers/22fa37ae-2cac-42ad-9332-ab7da7c574d5 => generated 1681 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:04:30.571655 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-0d520d99-a6e7-40c3-95aa-375c4e3d062e tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:04:30.572187 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-0d520d99-a6e7-40c3-95aa-375c4e3d062e tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] [instance: f4c73822-1dfa-4eed-bf02-1123b0402755] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:04:30.578629 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-0d520d99-a6e7-40c3-95aa-375c4e3d062e tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:30.579082 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-0d520d99-a6e7-40c3-95aa-375c4e3d062e tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:30.579844 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-0d520d99-a6e7-40c3-95aa-375c4e3d062e tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:30.580281 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-0d520d99-a6e7-40c3-95aa-375c4e3d062e tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:30.705155 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-0d520d99-a6e7-40c3-95aa-375c4e3d062e tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a993f5d14b64fccad723abecfcadf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b1be8431b0434d8bd6abca293127d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:04:30.712453 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-0d520d99-a6e7-40c3-95aa-375c4e3d062e tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] 10.222.0.17 "GET /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755" status: 200 len: 1677 microversion: 2.1 time: 0.144767 Jun 16 23:04:30.713013 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 254/510] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:04:30 2022] GET /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755 => generated 1677 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:04:30.759812 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-74cf189b-e022-4b45-8e9e-3747b5390815 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:04:30.760413 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-74cf189b-e022-4b45-8e9e-3747b5390815 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] [instance: 85395b04-657c-4595-83ca-b6a1635f6daa] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:04:30.767466 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-74cf189b-e022-4b45-8e9e-3747b5390815 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:30.767918 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-74cf189b-e022-4b45-8e9e-3747b5390815 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:30.768662 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-74cf189b-e022-4b45-8e9e-3747b5390815 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:30.769093 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-74cf189b-e022-4b45-8e9e-3747b5390815 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:30.903623 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-74cf189b-e022-4b45-8e9e-3747b5390815 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69163c28aa75492aa01c70532bed15a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9761759a69724a21b0b9315a931b106f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:04:30.911163 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-74cf189b-e022-4b45-8e9e-3747b5390815 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] 10.222.0.17 "GET /compute/v2.1/servers/85395b04-657c-4595-83ca-b6a1635f6daa" status: 200 len: 1319 microversion: 2.1 time: 0.155130 Jun 16 23:04:30.911733 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 257/511] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:04:30 2022] GET /compute/v2.1/servers/85395b04-657c-4595-83ca-b6a1635f6daa => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:04:31.001094 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-c5dd2621-589f-4295-8588-73ffa7f9c62d tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:04:31.001768 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-c5dd2621-589f-4295-8588-73ffa7f9c62d tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] [instance: 8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:04:31.007795 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-c5dd2621-589f-4295-8588-73ffa7f9c62d tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:31.008252 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-c5dd2621-589f-4295-8588-73ffa7f9c62d tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:31.009025 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-c5dd2621-589f-4295-8588-73ffa7f9c62d tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:31.009463 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-c5dd2621-589f-4295-8588-73ffa7f9c62d tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:31.139146 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-c5dd2621-589f-4295-8588-73ffa7f9c62d tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '243e592fbf1844d89f55dd5035a684f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60447df5461141e883d207e028b74bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:04:31.146889 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-c5dd2621-589f-4295-8588-73ffa7f9c62d tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] 10.222.0.17 "GET /compute/v2.1/servers/8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8" status: 200 len: 1735 microversion: 2.1 time: 0.150264 Jun 16 23:04:31.147443 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 255/512] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:04:30 2022] GET /compute/v2.1/servers/8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:04:31.362934 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-1a919216-c1d9-4d36-a47d-f35a2e482250 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:04:31.363548 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-1a919216-c1d9-4d36-a47d-f35a2e482250 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] [instance: 22fa37ae-2cac-42ad-9332-ab7da7c574d5] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:04:31.369462 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-1a919216-c1d9-4d36-a47d-f35a2e482250 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:31.369915 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-1a919216-c1d9-4d36-a47d-f35a2e482250 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:31.370694 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-1a919216-c1d9-4d36-a47d-f35a2e482250 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:31.371134 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-1a919216-c1d9-4d36-a47d-f35a2e482250 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:31.441156 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-1a919216-c1d9-4d36-a47d-f35a2e482250 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3a2d16133b4af8a208682de8a7d111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0526c12e8bc947209e24daf5ddfad7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:04:31.449259 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-1a919216-c1d9-4d36-a47d-f35a2e482250 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] 10.222.0.17 "GET /compute/v2.1/servers/22fa37ae-2cac-42ad-9332-ab7da7c574d5" status: 200 len: 1613 microversion: 2.1 time: 0.090003 Jun 16 23:04:31.449978 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 258/513] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:04:31 2022] GET /compute/v2.1/servers/22fa37ae-2cac-42ad-9332-ab7da7c574d5 => generated 1613 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:04:31.730024 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-ffdd00ce-ca8f-4064-b8f2-c3f74bfa140a tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:04:31.731269 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-ffdd00ce-ca8f-4064-b8f2-c3f74bfa140a tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] [instance: f4c73822-1dfa-4eed-bf02-1123b0402755] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:04:31.738709 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [req-478465c8-d416-4632-a15b-4d69588dc0bb req-e1072f26-a16c-4613-9cfe-663f7e410c5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22fa37ae-2cac-42ad-9332-ab7da7c574d5", "name": "network-vif-deleted", "tag": "e50a352e-8b05-48d5-9a0b-3df6a0efc12b"}]} {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 23:04:31.747185 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-ffdd00ce-ca8f-4064-b8f2-c3f74bfa140a tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:31.747640 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-ffdd00ce-ca8f-4064-b8f2-c3f74bfa140a tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:31.747818 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [req-478465c8-d416-4632-a15b-4d69588dc0bb req-e1072f26-a16c-4613-9cfe-663f7e410c5f service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:31.748394 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [req-478465c8-d416-4632-a15b-4d69588dc0bb req-e1072f26-a16c-4613-9cfe-663f7e410c5f service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:31.748525 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-ffdd00ce-ca8f-4064-b8f2-c3f74bfa140a tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:31.748839 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-ffdd00ce-ca8f-4064-b8f2-c3f74bfa140a tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:31.760564 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.compute.server_external_events [req-478465c8-d416-4632-a15b-4d69588dc0bb req-e1072f26-a16c-4613-9cfe-663f7e410c5f service nova] Creating event network-vif-deleted:e50a352e-8b05-48d5-9a0b-3df6a0efc12b for instance 22fa37ae-2cac-42ad-9332-ab7da7c574d5 on hv-cinder-84623 Jun 16 23:04:31.766284 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [req-478465c8-d416-4632-a15b-4d69588dc0bb req-e1072f26-a16c-4613-9cfe-663f7e410c5f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031241 Jun 16 23:04:31.767301 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 259/514] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 23:04:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 23:04:31.898783 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-ffdd00ce-ca8f-4064-b8f2-c3f74bfa140a tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a993f5d14b64fccad723abecfcadf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b1be8431b0434d8bd6abca293127d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:04:31.911752 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-ffdd00ce-ca8f-4064-b8f2-c3f74bfa140a tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] 10.222.0.17 "GET /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755" status: 200 len: 1677 microversion: 2.1 time: 0.185525 Jun 16 23:04:31.912632 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 256/515] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:04:31 2022] GET /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755 => generated 1677 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:04:31.928668 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-d64802ec-76ab-4c8a-a39a-72817ea14f04 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:04:31.929722 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-d64802ec-76ab-4c8a-a39a-72817ea14f04 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] [instance: 85395b04-657c-4595-83ca-b6a1635f6daa] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:04:31.936884 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-d64802ec-76ab-4c8a-a39a-72817ea14f04 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:31.937567 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-d64802ec-76ab-4c8a-a39a-72817ea14f04 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:31.938502 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-d64802ec-76ab-4c8a-a39a-72817ea14f04 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:31.939185 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-d64802ec-76ab-4c8a-a39a-72817ea14f04 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:32.075741 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-d64802ec-76ab-4c8a-a39a-72817ea14f04 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69163c28aa75492aa01c70532bed15a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9761759a69724a21b0b9315a931b106f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:04:32.083703 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-d64802ec-76ab-4c8a-a39a-72817ea14f04 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] 10.222.0.17 "GET /compute/v2.1/servers/85395b04-657c-4595-83ca-b6a1635f6daa" status: 200 len: 1509 microversion: 2.1 time: 0.159496 Jun 16 23:04:32.086754 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 260/516] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:04:31 2022] GET /compute/v2.1/servers/85395b04-657c-4595-83ca-b6a1635f6daa => generated 1509 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:04:32.100922 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-aa3233e8-d8aa-489f-98d7-13071618701f tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7257d5d0-a9fb-4dd3-9398-b555d51560d2", "device": "/dev/sdb"}} {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 23:04:32.102251 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-aa3233e8-d8aa-489f-98d7-13071618701f tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] [instance: 85395b04-657c-4595-83ca-b6a1635f6daa] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:04:32.108871 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-aa3233e8-d8aa-489f-98d7-13071618701f tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:32.109335 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-aa3233e8-d8aa-489f-98d7-13071618701f tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:32.110119 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-aa3233e8-d8aa-489f-98d7-13071618701f tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:32.110560 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-aa3233e8-d8aa-489f-98d7-13071618701f tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:32.165240 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-74d1adf2-aca5-4b70-8651-5191ffff5a84 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:04:32.166247 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-74d1adf2-aca5-4b70-8651-5191ffff5a84 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] [instance: 8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:04:32.173964 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-74d1adf2-aca5-4b70-8651-5191ffff5a84 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:32.174944 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-74d1adf2-aca5-4b70-8651-5191ffff5a84 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:32.176062 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-74d1adf2-aca5-4b70-8651-5191ffff5a84 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:32.176923 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-74d1adf2-aca5-4b70-8651-5191ffff5a84 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:32.327175 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-74d1adf2-aca5-4b70-8651-5191ffff5a84 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '243e592fbf1844d89f55dd5035a684f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60447df5461141e883d207e028b74bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:04:32.336547 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-74d1adf2-aca5-4b70-8651-5191ffff5a84 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] 10.222.0.17 "GET /compute/v2.1/servers/8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8" status: 200 len: 1735 microversion: 2.1 time: 0.176351 Jun 16 23:04:32.337316 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 261/517] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:04:32 2022] GET /compute/v2.1/servers/8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8 => generated 1735 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:04:32.468588 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-5f39786b-8b42-4c0f-99a2-c9082d4a5b09 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:04:32.469290 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-5f39786b-8b42-4c0f-99a2-c9082d4a5b09 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] [instance: 22fa37ae-2cac-42ad-9332-ab7da7c574d5] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:04:32.476508 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-5f39786b-8b42-4c0f-99a2-c9082d4a5b09 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:32.477051 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-5f39786b-8b42-4c0f-99a2-c9082d4a5b09 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:32.477834 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-5f39786b-8b42-4c0f-99a2-c9082d4a5b09 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:32.478324 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-5f39786b-8b42-4c0f-99a2-c9082d4a5b09 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:32.512581 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-5f39786b-8b42-4c0f-99a2-c9082d4a5b09 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:32.513028 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-5f39786b-8b42-4c0f-99a2-c9082d4a5b09 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:32.513477 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.objects.instance [None req-5f39786b-8b42-4c0f-99a2-c9082d4a5b09 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lazy-loading 'fault' on Instance uuid 22fa37ae-2cac-42ad-9332-ab7da7c574d5 {{(pid=117562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 23:04:32.555617 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-5f39786b-8b42-4c0f-99a2-c9082d4a5b09 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3a2d16133b4af8a208682de8a7d111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0526c12e8bc947209e24daf5ddfad7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:04:32.564003 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-5f39786b-8b42-4c0f-99a2-c9082d4a5b09 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] 10.222.0.17 "GET /compute/v2.1/servers/22fa37ae-2cac-42ad-9332-ab7da7c574d5" status: 200 len: 1331 microversion: 2.1 time: 0.100474 Jun 16 23:04:32.564858 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 262/518] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:04:32 2022] GET /compute/v2.1/servers/22fa37ae-2cac-42ad-9332-ab7da7c574d5 => generated 1331 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 23:04:32.931969 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-580c02a3-a4ca-449c-bb66-54c0b41deaae tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:04:32.932739 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-580c02a3-a4ca-449c-bb66-54c0b41deaae tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] [instance: f4c73822-1dfa-4eed-bf02-1123b0402755] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:04:32.940718 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-580c02a3-a4ca-449c-bb66-54c0b41deaae tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:32.941224 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-580c02a3-a4ca-449c-bb66-54c0b41deaae tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:32.941984 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-580c02a3-a4ca-449c-bb66-54c0b41deaae tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:32.942420 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-580c02a3-a4ca-449c-bb66-54c0b41deaae tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:33.077738 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-580c02a3-a4ca-449c-bb66-54c0b41deaae tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a993f5d14b64fccad723abecfcadf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b1be8431b0434d8bd6abca293127d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:04:33.085435 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-580c02a3-a4ca-449c-bb66-54c0b41deaae tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] 10.222.0.17 "GET /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755" status: 200 len: 1677 microversion: 2.1 time: 0.157661 Jun 16 23:04:33.086008 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 263/519] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:04:32 2022] GET /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755 => generated 1677 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 23:04:33.319640 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG dbcounter [-] [117563] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=117563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 23:04:33.337603 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-aa3233e8-d8aa-489f-98d7-13071618701f tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] 10.222.0.17 "POST /compute/v2.1/servers/85395b04-657c-4595-83ca-b6a1635f6daa/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.241208 Jun 16 23:04:33.338208 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 257/520] 10.222.0.17 () {60 vars in 1322 bytes} [Thu Jun 16 23:04:32 2022] POST /compute/v2.1/servers/85395b04-657c-4595-83ca-b6a1635f6daa/os-volume_attachments => generated 194 bytes in 1243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 23:04:33.354131 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-8bfe93d3-2169-4e5e-b6a0-be7d4db907e2 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:04:33.354782 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-8bfe93d3-2169-4e5e-b6a0-be7d4db907e2 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] [instance: 8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:04:33.361774 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-8bfe93d3-2169-4e5e-b6a0-be7d4db907e2 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:33.362232 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-8bfe93d3-2169-4e5e-b6a0-be7d4db907e2 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:33.363035 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-8bfe93d3-2169-4e5e-b6a0-be7d4db907e2 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:33.363478 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-8bfe93d3-2169-4e5e-b6a0-be7d4db907e2 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:33.498050 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-8bfe93d3-2169-4e5e-b6a0-be7d4db907e2 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '243e592fbf1844d89f55dd5035a684f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60447df5461141e883d207e028b74bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:04:33.508018 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-8bfe93d3-2169-4e5e-b6a0-be7d4db907e2 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] 10.222.0.17 "GET /compute/v2.1/servers/8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8" status: 200 len: 1715 microversion: 2.1 time: 0.157696 Jun 16 23:04:33.508571 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 264/521] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:04:33 2022] GET /compute/v2.1/servers/8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8 => generated 1715 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:04:33.582093 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-e33d5b14-bb88-42bb-a220-bd2437373946 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:04:33.582812 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-e33d5b14-bb88-42bb-a220-bd2437373946 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] [instance: 22fa37ae-2cac-42ad-9332-ab7da7c574d5] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:04:33.589052 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-e33d5b14-bb88-42bb-a220-bd2437373946 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:33.589497 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-e33d5b14-bb88-42bb-a220-bd2437373946 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:33.590805 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-e33d5b14-bb88-42bb-a220-bd2437373946 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:33.591241 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-e33d5b14-bb88-42bb-a220-bd2437373946 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:33.610280 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-36493d78-3ee6-468c-986e-caca89d804b2 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:04:33.610846 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-36493d78-3ee6-468c-986e-caca89d804b2 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] [instance: 8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:04:33.616729 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-36493d78-3ee6-468c-986e-caca89d804b2 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:33.617181 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-36493d78-3ee6-468c-986e-caca89d804b2 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:33.617944 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-36493d78-3ee6-468c-986e-caca89d804b2 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:33.618385 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-36493d78-3ee6-468c-986e-caca89d804b2 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:33.622283 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG dbcounter [-] [117562] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 23:04:33.627860 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-e33d5b14-bb88-42bb-a220-bd2437373946 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:33.628311 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-e33d5b14-bb88-42bb-a220-bd2437373946 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:33.628757 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.objects.instance [None req-e33d5b14-bb88-42bb-a220-bd2437373946 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lazy-loading 'fault' on Instance uuid 22fa37ae-2cac-42ad-9332-ab7da7c574d5 {{(pid=117563) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 23:04:33.675574 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-e33d5b14-bb88-42bb-a220-bd2437373946 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3a2d16133b4af8a208682de8a7d111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0526c12e8bc947209e24daf5ddfad7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:04:33.682952 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-e33d5b14-bb88-42bb-a220-bd2437373946 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] 10.222.0.17 "GET /compute/v2.1/servers/22fa37ae-2cac-42ad-9332-ab7da7c574d5" status: 200 len: 1331 microversion: 2.1 time: 0.105451 Jun 16 23:04:33.683505 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 258/522] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:04:33 2022] GET /compute/v2.1/servers/22fa37ae-2cac-42ad-9332-ab7da7c574d5 => generated 1331 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:04:33.698875 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.wsgi [None req-36493d78-3ee6-468c-986e-caca89d804b2 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] HTTP exception thrown: Cannot 'detach_volume' instance 8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8 while it is in vm_state rescued Jun 16 23:04:33.701043 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-36493d78-3ee6-468c-986e-caca89d804b2 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Request method failure captured: Jun 16 23:04:33.701043 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: request: DELETE /compute/v2.1/servers/8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8/os-volume_attachments/69f331a4-aab1-45fb-8cec-8bbb86e65d81 HTTP/1.1 Jun 16 23:04:33.701043 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Accept: application/json Jun 16 23:04:33.701043 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Accept-Encoding: identity Jun 16 23:04:33.701043 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Connection: close Jun 16 23:04:33.701043 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Content-Length: 0 Jun 16 23:04:33.701043 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Content-Type: application/json Jun 16 23:04:33.701043 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Host: 10.222.0.17 Jun 16 23:04:33.701043 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Openstack-System-Scope: None Jun 16 23:04:33.701043 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: User-Agent: python-urllib3/1.26.9 Jun 16 23:04:33.701043 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Auth-Token: gAAAAABiq7Ybpb0QO0FcFn_EOw5P6FTbOHo1mCVh1QS4wC871UGlRsfydiFbvefR_ouEKZbaz8Cp87VYbn--bsc0A8Z56HhTuujXXbcpoO2sA3ojRA0C8Q-lwRF3sq-FBCCjaN6ItRbHJC1L8ezexrcUPCnREK8HUDeFj-L4igPJ9X0jeAiI_Ic Jun 16 23:04:33.701043 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Domain-Id: None Jun 16 23:04:33.701043 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Domain-Name: None Jun 16 23:04:33.701043 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Identity-Status: Confirmed Jun 16 23:04:33.701043 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Is-Admin-Project: True Jun 16 23:04:33.701043 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Project-Domain-Id: default Jun 16 23:04:33.701043 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Project-Domain-Name: Default Jun 16 23:04:33.701043 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Project-Id: 60447df5461141e883d207e028b74bc7 Jun 16 23:04:33.701043 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1782574210 Jun 16 23:04:33.701043 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Role: member,reader Jun 16 23:04:33.701043 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Roles: member,reader Jun 16 23:04:33.702660 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/60447df5461141e883d207e028b74bc7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_60447df5461141e883d207e028b74bc7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/60447df5461141e883d207e028b74bc7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/60447df5461141e883d207e028b74bc7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Jun 16 23:04:33.702660 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1782574210 Jun 16 23:04:33.702660 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Tenant-Id: 60447df5461141e883d207e028b74bc7 Jun 16 23:04:33.702660 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1782574210 Jun 16 23:04:33.702660 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-User: tempest-ServerRescueNegativeTestJSON-1782574210-project Jun 16 23:04:33.702660 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-User-Domain-Id: default Jun 16 23:04:33.702660 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-User-Domain-Name: Default Jun 16 23:04:33.702660 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-User-Id: 243e592fbf1844d89f55dd5035a684f3 Jun 16 23:04:33.702660 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1782574210-project Jun 16 23:04:33.702660 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: method: > Jun 16 23:04:33.702660 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: exception: Cannot 'detach_volume' instance 8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8 while it is in vm_state rescued Jun 16 23:04:33.703443 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: action_args: {'server_id': '8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8', 'id': '69f331a4-aab1-45fb-8cec-8bbb86e65d81'} Jun 16 23:04:33.703443 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 23:04:33.703443 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 23:04:33.703443 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 16 23:04:33.703443 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 16 23:04:33.703443 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 16 23:04:33.703443 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 16 23:04:33.703443 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 16 23:04:33.703443 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 16 23:04:33.703443 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jun 16 23:04:33.703443 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Jun 16 23:04:33.703443 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 23:04:33.703443 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Jun 16 23:04:33.703443 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 23:04:33.703443 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 23:04:33.703443 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 23:04:33.703443 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 23:04:33.703443 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 23:04:33.703443 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 23:04:33.703443 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 23:04:33.704803 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jun 16 23:04:33.704803 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 16 23:04:33.704803 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 16 23:04:33.704803 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 16 23:04:33.704803 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8 while it is in vm_state rescued Jun 16 23:04:33.704803 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Jun 16 23:04:33.704803 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 23:04:33.704803 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Jun 16 23:04:33.704803 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 23:04:33.704803 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 23:04:33.704803 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 23:04:33.704803 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 23:04:33.704803 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 23:04:33.704803 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8 while it is in vm_state rescued Jun 16 23:04:33.704803 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Jun 16 23:04:33.704803 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-36493d78-3ee6-468c-986e-caca89d804b2 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Returning 409 to user: Cannot 'detach_volume' instance 8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8 while it is in vm_state rescued {{(pid=117562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 23:04:33.706025 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-36493d78-3ee6-468c-986e-caca89d804b2 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] 10.222.0.17 "DELETE /compute/v2.1/servers/8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8/os-volume_attachments/69f331a4-aab1-45fb-8cec-8bbb86e65d81" status: 409 len: 152 microversion: 2.1 time: 0.096682 Jun 16 23:04:33.706025 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 265/523] 10.222.0.17 () {58 vars in 1415 bytes} [Thu Jun 16 23:04:33 2022] DELETE /compute/v2.1/servers/8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8/os-volume_attachments/69f331a4-aab1-45fb-8cec-8bbb86e65d81 => generated 152 bytes in 98 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jun 16 23:04:33.713636 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-0c170ff5-3ceb-4379-88f8-ad4fb985d6fb tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 23:04:33.714254 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-0c170ff5-3ceb-4379-88f8-ad4fb985d6fb tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] [instance: 8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:04:33.723552 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-0c170ff5-3ceb-4379-88f8-ad4fb985d6fb tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:33.724173 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-0c170ff5-3ceb-4379-88f8-ad4fb985d6fb tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:33.726078 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-0c170ff5-3ceb-4379-88f8-ad4fb985d6fb tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:33.726878 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-0c170ff5-3ceb-4379-88f8-ad4fb985d6fb tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:33.815674 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-0c170ff5-3ceb-4379-88f8-ad4fb985d6fb tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] 10.222.0.17 "POST /compute/v2.1/servers/8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8/action" status: 202 len: 0 microversion: 2.1 time: 0.101315 Jun 16 23:04:33.815674 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 259/524] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Jun 16 23:04:33 2022] POST /compute/v2.1/servers/8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8/action => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 16 23:04:33.822883 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-ddcfc844-d87e-4368-96b5-7e1eb9ac1ffd tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:04:33.826832 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-ddcfc844-d87e-4368-96b5-7e1eb9ac1ffd tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] [instance: 8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:04:33.839467 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-ddcfc844-d87e-4368-96b5-7e1eb9ac1ffd tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:33.841121 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-ddcfc844-d87e-4368-96b5-7e1eb9ac1ffd tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:33.841946 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-ddcfc844-d87e-4368-96b5-7e1eb9ac1ffd tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:33.842384 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-ddcfc844-d87e-4368-96b5-7e1eb9ac1ffd tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:33.997686 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-ddcfc844-d87e-4368-96b5-7e1eb9ac1ffd tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '243e592fbf1844d89f55dd5035a684f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60447df5461141e883d207e028b74bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:04:34.005836 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-ddcfc844-d87e-4368-96b5-7e1eb9ac1ffd tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] 10.222.0.17 "GET /compute/v2.1/servers/8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8" status: 200 len: 1723 microversion: 2.1 time: 0.188383 Jun 16 23:04:34.006989 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 266/525] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:04:33 2022] GET /compute/v2.1/servers/8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8 => generated 1723 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:04:34.103239 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-cd1c6993-fa7d-42eb-9689-ce4bb8f44110 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:04:34.103933 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-cd1c6993-fa7d-42eb-9689-ce4bb8f44110 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] [instance: f4c73822-1dfa-4eed-bf02-1123b0402755] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:04:34.110885 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-cd1c6993-fa7d-42eb-9689-ce4bb8f44110 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:34.111337 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-cd1c6993-fa7d-42eb-9689-ce4bb8f44110 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:34.112140 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-cd1c6993-fa7d-42eb-9689-ce4bb8f44110 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:34.112581 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-cd1c6993-fa7d-42eb-9689-ce4bb8f44110 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:34.247265 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-cd1c6993-fa7d-42eb-9689-ce4bb8f44110 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a993f5d14b64fccad723abecfcadf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b1be8431b0434d8bd6abca293127d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:04:34.255171 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-cd1c6993-fa7d-42eb-9689-ce4bb8f44110 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] 10.222.0.17 "GET /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755" status: 200 len: 1677 microversion: 2.1 time: 0.156307 Jun 16 23:04:34.256169 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 260/526] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:04:34 2022] GET /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755 => generated 1677 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:04:34.699836 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-994b7d7a-5339-4d3b-b07c-cb100780b24a tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:04:34.700443 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-994b7d7a-5339-4d3b-b07c-cb100780b24a tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] [instance: 22fa37ae-2cac-42ad-9332-ab7da7c574d5] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:04:34.706336 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-994b7d7a-5339-4d3b-b07c-cb100780b24a tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:34.706826 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-994b7d7a-5339-4d3b-b07c-cb100780b24a tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:34.707593 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-994b7d7a-5339-4d3b-b07c-cb100780b24a tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:34.708030 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-994b7d7a-5339-4d3b-b07c-cb100780b24a tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:34.722391 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.wsgi [None req-994b7d7a-5339-4d3b-b07c-cb100780b24a tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] HTTP exception thrown: Instance 22fa37ae-2cac-42ad-9332-ab7da7c574d5 could not be found. Jun 16 23:04:34.723943 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-994b7d7a-5339-4d3b-b07c-cb100780b24a tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Request method failure captured: Jun 16 23:04:34.723943 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: request: GET /compute/v2.1/servers/22fa37ae-2cac-42ad-9332-ab7da7c574d5 HTTP/1.1 Jun 16 23:04:34.723943 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Accept: application/json Jun 16 23:04:34.723943 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Accept-Encoding: identity Jun 16 23:04:34.723943 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Connection: close Jun 16 23:04:34.723943 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Content-Length: 0 Jun 16 23:04:34.723943 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Content-Type: application/json Jun 16 23:04:34.723943 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Host: 10.222.0.17 Jun 16 23:04:34.723943 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Openstack-System-Scope: None Jun 16 23:04:34.723943 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: User-Agent: python-urllib3/1.26.9 Jun 16 23:04:34.723943 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Auth-Token: gAAAAABiq7YeRQnlz8l2GSIF0VOET6Y1W8yBB5oz1cYYpYFcfT7cYY0kIvo4O2qRVrDvagXVbkghr-k-KGb8GCGo_mbQOK1vAXciruDemULKCP_QAI9xPZafRW81TxgAIAvJEx6CPJUGbCIq4SyYsx25OB1SZXBFh8aRZWpbG6CQ65KEZvQlgIo Jun 16 23:04:34.723943 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Domain-Id: None Jun 16 23:04:34.723943 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Domain-Name: None Jun 16 23:04:34.723943 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Identity-Status: Confirmed Jun 16 23:04:34.723943 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Is-Admin-Project: True Jun 16 23:04:34.723943 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Project-Domain-Id: default Jun 16 23:04:34.723943 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Project-Domain-Name: Default Jun 16 23:04:34.723943 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Project-Id: 0526c12e8bc947209e24daf5ddfad7be Jun 16 23:04:34.723943 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Project-Name: tempest-AttachVolumeNegativeTest-1967724585 Jun 16 23:04:34.723943 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Role: member,reader Jun 16 23:04:34.723943 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Roles: member,reader Jun 16 23:04:34.725416 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/0526c12e8bc947209e24daf5ddfad7be"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_0526c12e8bc947209e24daf5ddfad7be"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0526c12e8bc947209e24daf5ddfad7be"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0526c12e8bc947209e24daf5ddfad7be"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Jun 16 23:04:34.725416 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Tenant: tempest-AttachVolumeNegativeTest-1967724585 Jun 16 23:04:34.725416 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Tenant-Id: 0526c12e8bc947209e24daf5ddfad7be Jun 16 23:04:34.725416 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1967724585 Jun 16 23:04:34.725416 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-User: tempest-AttachVolumeNegativeTest-1967724585-project Jun 16 23:04:34.725416 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-User-Domain-Id: default Jun 16 23:04:34.725416 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-User-Domain-Name: Default Jun 16 23:04:34.725416 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-User-Id: 9e3a2d16133b4af8a208682de8a7d111 Jun 16 23:04:34.725416 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-User-Name: tempest-AttachVolumeNegativeTest-1967724585-project Jun 16 23:04:34.725416 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: method: > Jun 16 23:04:34.725416 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: exception: Instance 22fa37ae-2cac-42ad-9332-ab7da7c574d5 could not be found. Jun 16 23:04:34.725416 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: action_args: {'id': '22fa37ae-2cac-42ad-9332-ab7da7c574d5'} Jun 16 23:04:34.726307 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 23:04:34.726307 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 23:04:34.726307 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 23:04:34.726307 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 23:04:34.726307 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 23:04:34.726307 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 23:04:34.726307 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 23:04:34.726307 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 23:04:34.726307 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 23:04:34.726307 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 23:04:34.726307 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22fa37ae-2cac-42ad-9332-ab7da7c574d5 could not be found. Jun 16 23:04:34.726307 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Jun 16 23:04:34.726307 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 23:04:34.726307 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Jun 16 23:04:34.726307 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 23:04:34.726307 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 23:04:34.726307 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 23:04:34.726307 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 23:04:34.726307 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 23:04:34.726307 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 23:04:34.727701 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 23:04:34.727701 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 23:04:34.727701 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 23:04:34.727701 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 23:04:34.727701 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 23:04:34.727701 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 23:04:34.727701 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 23:04:34.727701 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22fa37ae-2cac-42ad-9332-ab7da7c574d5 could not be found. Jun 16 23:04:34.727701 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Jun 16 23:04:34.727701 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 23:04:34.727701 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Jun 16 23:04:34.727701 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 23:04:34.727701 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 23:04:34.727701 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 23:04:34.727701 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 23:04:34.727701 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 23:04:34.727701 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22fa37ae-2cac-42ad-9332-ab7da7c574d5 could not be found. Jun 16 23:04:34.727701 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Jun 16 23:04:34.728963 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-994b7d7a-5339-4d3b-b07c-cb100780b24a tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Returning 404 to user: Instance 22fa37ae-2cac-42ad-9332-ab7da7c574d5 could not be found. {{(pid=117562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 23:04:34.728963 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-994b7d7a-5339-4d3b-b07c-cb100780b24a tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] 10.222.0.17 "GET /compute/v2.1/servers/22fa37ae-2cac-42ad-9332-ab7da7c574d5" status: 404 len: 111 microversion: 2.1 time: 0.029292 Jun 16 23:04:34.728963 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 267/527] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:04:34 2022] GET /compute/v2.1/servers/22fa37ae-2cac-42ad-9332-ab7da7c574d5 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 23:04:34.734511 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-6ee41b67-bf50-48d6-a1ca-d99d836c4ba6 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Calling method '.version_select at 0x7f53135c7940>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:04:34.752811 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-6ee41b67-bf50-48d6-a1ca-d99d836c4ba6 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1359086876" status: 202 len: 0 microversion: 2.1 time: 0.022569 Jun 16 23:04:34.753351 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 261/528] 10.222.0.17 () {58 vars in 1220 bytes} [Thu Jun 16 23:04:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1359086876 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 23:04:35.023377 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-5515b97b-75bb-4b6b-9097-df8472a0450d tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:04:35.024124 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-5515b97b-75bb-4b6b-9097-df8472a0450d tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] [instance: 8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:04:35.031136 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-5515b97b-75bb-4b6b-9097-df8472a0450d tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:35.031665 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-5515b97b-75bb-4b6b-9097-df8472a0450d tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:35.032638 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-5515b97b-75bb-4b6b-9097-df8472a0450d tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:35.033139 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-5515b97b-75bb-4b6b-9097-df8472a0450d tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:35.168086 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-5515b97b-75bb-4b6b-9097-df8472a0450d tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '243e592fbf1844d89f55dd5035a684f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60447df5461141e883d207e028b74bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:04:35.176666 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-5515b97b-75bb-4b6b-9097-df8472a0450d tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] 10.222.0.17 "GET /compute/v2.1/servers/8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8" status: 200 len: 1723 microversion: 2.1 time: 0.157079 Jun 16 23:04:35.177342 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 268/529] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:04:35 2022] GET /compute/v2.1/servers/8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:04:35.273226 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-9a57171f-a2ea-4587-9cd1-b9e1bbd787d4 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:04:35.273921 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-9a57171f-a2ea-4587-9cd1-b9e1bbd787d4 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] [instance: f4c73822-1dfa-4eed-bf02-1123b0402755] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:04:35.280780 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-9a57171f-a2ea-4587-9cd1-b9e1bbd787d4 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:35.281507 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-9a57171f-a2ea-4587-9cd1-b9e1bbd787d4 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:35.282408 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-9a57171f-a2ea-4587-9cd1-b9e1bbd787d4 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:35.282989 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-9a57171f-a2ea-4587-9cd1-b9e1bbd787d4 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:35.412605 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-9a57171f-a2ea-4587-9cd1-b9e1bbd787d4 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a993f5d14b64fccad723abecfcadf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b1be8431b0434d8bd6abca293127d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:04:35.417411 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-c41949f9-9374-4a4e-b130-e8fb30ab95c3 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:04:35.418381 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-c41949f9-9374-4a4e-b130-e8fb30ab95c3 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] [instance: 5cfd118b-cc42-4dbe-93f1-784454892318] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:04:35.420866 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-9a57171f-a2ea-4587-9cd1-b9e1bbd787d4 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] 10.222.0.17 "GET /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755" status: 200 len: 1677 microversion: 2.1 time: 0.151459 Jun 16 23:04:35.421432 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 262/530] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:04:35 2022] GET /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755 => generated 1677 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:04:35.424822 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-c41949f9-9374-4a4e-b130-e8fb30ab95c3 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:35.425277 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-c41949f9-9374-4a4e-b130-e8fb30ab95c3 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:35.426042 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-c41949f9-9374-4a4e-b130-e8fb30ab95c3 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:35.426520 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-c41949f9-9374-4a4e-b130-e8fb30ab95c3 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:35.505839 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.objects.instance [None req-c41949f9-9374-4a4e-b130-e8fb30ab95c3 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lazy-loading 'services' on Instance uuid 5cfd118b-cc42-4dbe-93f1-784454892318 {{(pid=117562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 23:04:35.574627 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-c41949f9-9374-4a4e-b130-e8fb30ab95c3 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] 10.222.0.17 "DELETE /compute/v2.1/servers/5cfd118b-cc42-4dbe-93f1-784454892318/os-volume_attachments/2206e81b-0e64-49bd-bc05-08fb12cab02d" status: 202 len: 0 microversion: 2.1 time: 0.160922 Jun 16 23:04:35.575208 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 269/531] 10.222.0.17 () {58 vars in 1415 bytes} [Thu Jun 16 23:04:35 2022] DELETE /compute/v2.1/servers/5cfd118b-cc42-4dbe-93f1-784454892318/os-volume_attachments/2206e81b-0e64-49bd-bc05-08fb12cab02d => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 16 23:04:35.583387 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-38d9f62b-c629-4cc9-a70f-af007fd06389 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:04:35.584396 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-38d9f62b-c629-4cc9-a70f-af007fd06389 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] [instance: 5cfd118b-cc42-4dbe-93f1-784454892318] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:04:35.590887 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-38d9f62b-c629-4cc9-a70f-af007fd06389 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:35.591346 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-38d9f62b-c629-4cc9-a70f-af007fd06389 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:35.592093 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-38d9f62b-c629-4cc9-a70f-af007fd06389 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:35.592528 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-38d9f62b-c629-4cc9-a70f-af007fd06389 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:35.620761 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-38d9f62b-c629-4cc9-a70f-af007fd06389 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] 10.222.0.17 "GET /compute/v2.1/servers/5cfd118b-cc42-4dbe-93f1-784454892318/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041289 Jun 16 23:04:35.621323 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 263/532] 10.222.0.17 () {58 vars in 1301 bytes} [Thu Jun 16 23:04:35 2022] GET /compute/v2.1/servers/5cfd118b-cc42-4dbe-93f1-784454892318/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 23:04:36.194254 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-7dedf005-1675-4591-b503-4a6bb1b11e1e tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:04:36.195031 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-7dedf005-1675-4591-b503-4a6bb1b11e1e tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] [instance: 8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:04:36.202923 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-7dedf005-1675-4591-b503-4a6bb1b11e1e tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:36.204586 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-7dedf005-1675-4591-b503-4a6bb1b11e1e tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:36.204586 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-7dedf005-1675-4591-b503-4a6bb1b11e1e tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:36.204586 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-7dedf005-1675-4591-b503-4a6bb1b11e1e tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:36.437519 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-671b19da-abbc-4d0b-b360-fb7cf2bf29b6 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:04:36.439517 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-671b19da-abbc-4d0b-b360-fb7cf2bf29b6 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] [instance: f4c73822-1dfa-4eed-bf02-1123b0402755] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:04:36.445166 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-671b19da-abbc-4d0b-b360-fb7cf2bf29b6 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:36.445541 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-671b19da-abbc-4d0b-b360-fb7cf2bf29b6 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:36.446326 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-671b19da-abbc-4d0b-b360-fb7cf2bf29b6 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:36.446804 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-671b19da-abbc-4d0b-b360-fb7cf2bf29b6 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:36.582127 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-7dedf005-1675-4591-b503-4a6bb1b11e1e tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '243e592fbf1844d89f55dd5035a684f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60447df5461141e883d207e028b74bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:04:36.590707 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-7dedf005-1675-4591-b503-4a6bb1b11e1e tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] 10.222.0.17 "GET /compute/v2.1/servers/8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8" status: 200 len: 1723 microversion: 2.1 time: 0.401069 Jun 16 23:04:36.591279 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 270/533] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:04:36 2022] GET /compute/v2.1/servers/8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8 => generated 1723 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:04:36.632442 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-364fb4ae-7e6b-4052-8318-eea004f86176 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:04:36.633510 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-364fb4ae-7e6b-4052-8318-eea004f86176 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] [instance: 5cfd118b-cc42-4dbe-93f1-784454892318] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:04:36.640079 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-364fb4ae-7e6b-4052-8318-eea004f86176 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:36.640622 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-364fb4ae-7e6b-4052-8318-eea004f86176 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:36.641467 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-364fb4ae-7e6b-4052-8318-eea004f86176 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:36.641996 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-364fb4ae-7e6b-4052-8318-eea004f86176 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:36.663028 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-671b19da-abbc-4d0b-b360-fb7cf2bf29b6 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a993f5d14b64fccad723abecfcadf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b1be8431b0434d8bd6abca293127d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:04:36.671123 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-671b19da-abbc-4d0b-b360-fb7cf2bf29b6 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] 10.222.0.17 "GET /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755" status: 200 len: 1677 microversion: 2.1 time: 0.237665 Jun 16 23:04:36.671718 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 264/534] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:04:36 2022] GET /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755 => generated 1677 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 23:04:36.672097 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-364fb4ae-7e6b-4052-8318-eea004f86176 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] 10.222.0.17 "GET /compute/v2.1/servers/5cfd118b-cc42-4dbe-93f1-784454892318/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043537 Jun 16 23:04:36.672645 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 271/535] 10.222.0.17 () {58 vars in 1301 bytes} [Thu Jun 16 23:04:36 2022] GET /compute/v2.1/servers/5cfd118b-cc42-4dbe-93f1-784454892318/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 23:04:37.607207 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-7e9c437b-279b-49b2-a11c-79669428fb35 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:04:37.607808 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-7e9c437b-279b-49b2-a11c-79669428fb35 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] [instance: 8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:04:37.614473 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-7e9c437b-279b-49b2-a11c-79669428fb35 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:37.614968 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-7e9c437b-279b-49b2-a11c-79669428fb35 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:37.615738 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-7e9c437b-279b-49b2-a11c-79669428fb35 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:37.616175 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-7e9c437b-279b-49b2-a11c-79669428fb35 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:37.684489 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-d48bb768-4493-4466-b5e6-05e8474908ca tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:04:37.685458 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-d48bb768-4493-4466-b5e6-05e8474908ca tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] [instance: 5cfd118b-cc42-4dbe-93f1-784454892318] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:04:37.691820 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-d48bb768-4493-4466-b5e6-05e8474908ca tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:37.692271 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-d48bb768-4493-4466-b5e6-05e8474908ca tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:37.693091 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-d48bb768-4493-4466-b5e6-05e8474908ca tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:37.693529 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-d48bb768-4493-4466-b5e6-05e8474908ca tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:37.722229 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-d48bb768-4493-4466-b5e6-05e8474908ca tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] 10.222.0.17 "GET /compute/v2.1/servers/5cfd118b-cc42-4dbe-93f1-784454892318/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042458 Jun 16 23:04:37.722810 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 272/536] 10.222.0.17 () {58 vars in 1301 bytes} [Thu Jun 16 23:04:37 2022] GET /compute/v2.1/servers/5cfd118b-cc42-4dbe-93f1-784454892318/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 23:04:37.727121 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-d76bbb0b-2fb4-4b8f-b953-8b0e82191cdc tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:04:37.727710 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-d76bbb0b-2fb4-4b8f-b953-8b0e82191cdc tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] [instance: f4c73822-1dfa-4eed-bf02-1123b0402755] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:04:37.734393 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-d76bbb0b-2fb4-4b8f-b953-8b0e82191cdc tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:37.734871 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-d76bbb0b-2fb4-4b8f-b953-8b0e82191cdc tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:37.735638 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-d76bbb0b-2fb4-4b8f-b953-8b0e82191cdc tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:37.736071 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-d76bbb0b-2fb4-4b8f-b953-8b0e82191cdc tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:37.744690 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-7e9c437b-279b-49b2-a11c-79669428fb35 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '243e592fbf1844d89f55dd5035a684f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60447df5461141e883d207e028b74bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:04:37.753047 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-7e9c437b-279b-49b2-a11c-79669428fb35 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] 10.222.0.17 "GET /compute/v2.1/servers/8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8" status: 200 len: 1729 microversion: 2.1 time: 0.150161 Jun 16 23:04:37.753599 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 265/537] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:04:37 2022] GET /compute/v2.1/servers/8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8 => generated 1729 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:04:37.768864 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-e2ef5c37-f9b6-401e-81a3-d5c9e8841934 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:04:37.769351 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-e2ef5c37-f9b6-401e-81a3-d5c9e8841934 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] [instance: 8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:04:37.775270 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-e2ef5c37-f9b6-401e-81a3-d5c9e8841934 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:37.775722 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-e2ef5c37-f9b6-401e-81a3-d5c9e8841934 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:37.776487 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-e2ef5c37-f9b6-401e-81a3-d5c9e8841934 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:37.777424 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-e2ef5c37-f9b6-401e-81a3-d5c9e8841934 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:37.874106 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-e2ef5c37-f9b6-401e-81a3-d5c9e8841934 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] 10.222.0.17 "GET /compute/v2.1/servers/8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.108868 Jun 16 23:04:37.874714 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 266/538] 10.222.0.17 () {58 vars in 1274 bytes} [Thu Jun 16 23:04:37 2022] GET /compute/v2.1/servers/8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8/os-interface => generated 284 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 23:04:37.900202 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-d76bbb0b-2fb4-4b8f-b953-8b0e82191cdc tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a993f5d14b64fccad723abecfcadf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b1be8431b0434d8bd6abca293127d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:04:37.908354 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-d76bbb0b-2fb4-4b8f-b953-8b0e82191cdc tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] 10.222.0.17 "GET /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755" status: 200 len: 1677 microversion: 2.1 time: 0.184606 Jun 16 23:04:37.909021 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 273/539] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:04:37 2022] GET /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755 => generated 1677 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:04:38.734486 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-3ffeb3f2-fd3f-40e7-a8cd-c84dfdd8f8d6 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:04:38.735632 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-3ffeb3f2-fd3f-40e7-a8cd-c84dfdd8f8d6 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] [instance: 5cfd118b-cc42-4dbe-93f1-784454892318] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:04:38.740501 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [req-c06acd20-7427-4f85-b2eb-94ac008fffa9 req-e2f8850c-ee26-4263-8587-dbea0e8ca750 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8", "tag": "823b7d46-8462-4945-943b-09a9fc1c8dce"}]} {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 23:04:38.742209 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-3ffeb3f2-fd3f-40e7-a8cd-c84dfdd8f8d6 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:38.742899 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-3ffeb3f2-fd3f-40e7-a8cd-c84dfdd8f8d6 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:38.744246 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-3ffeb3f2-fd3f-40e7-a8cd-c84dfdd8f8d6 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:38.745020 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-3ffeb3f2-fd3f-40e7-a8cd-c84dfdd8f8d6 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:38.750959 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [req-c06acd20-7427-4f85-b2eb-94ac008fffa9 req-e2f8850c-ee26-4263-8587-dbea0e8ca750 service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:38.751408 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [req-c06acd20-7427-4f85-b2eb-94ac008fffa9 req-e2f8850c-ee26-4263-8587-dbea0e8ca750 service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:38.771526 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.compute.server_external_events [req-c06acd20-7427-4f85-b2eb-94ac008fffa9 req-e2f8850c-ee26-4263-8587-dbea0e8ca750 service nova] Creating event network-changed:823b7d46-8462-4945-943b-09a9fc1c8dce for instance 8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8 on hv-cinder-84623 Jun 16 23:04:38.776733 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [req-c06acd20-7427-4f85-b2eb-94ac008fffa9 req-e2f8850c-ee26-4263-8587-dbea0e8ca750 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040054 Jun 16 23:04:38.777443 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 274/540] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 23:04:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 23:04:38.788238 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-3ffeb3f2-fd3f-40e7-a8cd-c84dfdd8f8d6 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] 10.222.0.17 "GET /compute/v2.1/servers/5cfd118b-cc42-4dbe-93f1-784454892318/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058683 Jun 16 23:04:38.788806 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 267/541] 10.222.0.17 () {58 vars in 1301 bytes} [Thu Jun 16 23:04:38 2022] GET /compute/v2.1/servers/5cfd118b-cc42-4dbe-93f1-784454892318/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 23:04:38.925978 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-2447de37-e65a-4639-98ba-11ed83fb0e27 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:04:38.926851 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-2447de37-e65a-4639-98ba-11ed83fb0e27 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] [instance: f4c73822-1dfa-4eed-bf02-1123b0402755] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:04:38.937311 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-2447de37-e65a-4639-98ba-11ed83fb0e27 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:38.937916 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-2447de37-e65a-4639-98ba-11ed83fb0e27 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:38.938870 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-2447de37-e65a-4639-98ba-11ed83fb0e27 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:38.939484 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-2447de37-e65a-4639-98ba-11ed83fb0e27 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:39.081999 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-2447de37-e65a-4639-98ba-11ed83fb0e27 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a993f5d14b64fccad723abecfcadf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b1be8431b0434d8bd6abca293127d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:04:39.091228 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-2447de37-e65a-4639-98ba-11ed83fb0e27 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] 10.222.0.17 "GET /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755" status: 200 len: 1677 microversion: 2.1 time: 0.169581 Jun 16 23:04:39.092123 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 275/542] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:04:38 2022] GET /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755 => generated 1677 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:04:39.799985 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-3c8f7c73-2322-46a5-9054-23f9819c5561 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:04:39.800911 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-3c8f7c73-2322-46a5-9054-23f9819c5561 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] [instance: 5cfd118b-cc42-4dbe-93f1-784454892318] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:04:39.807435 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-3c8f7c73-2322-46a5-9054-23f9819c5561 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:39.807891 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-3c8f7c73-2322-46a5-9054-23f9819c5561 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:39.808650 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-3c8f7c73-2322-46a5-9054-23f9819c5561 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:39.809089 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-3c8f7c73-2322-46a5-9054-23f9819c5561 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:39.837876 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-3c8f7c73-2322-46a5-9054-23f9819c5561 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] 10.222.0.17 "GET /compute/v2.1/servers/5cfd118b-cc42-4dbe-93f1-784454892318/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041905 Jun 16 23:04:39.838639 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 268/543] 10.222.0.17 () {58 vars in 1301 bytes} [Thu Jun 16 23:04:39 2022] GET /compute/v2.1/servers/5cfd118b-cc42-4dbe-93f1-784454892318/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 23:04:40.109224 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-821f80fd-5c9b-4285-9a72-6e528458f662 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:04:40.109842 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-821f80fd-5c9b-4285-9a72-6e528458f662 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] [instance: f4c73822-1dfa-4eed-bf02-1123b0402755] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:04:40.116533 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-821f80fd-5c9b-4285-9a72-6e528458f662 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:40.116986 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-821f80fd-5c9b-4285-9a72-6e528458f662 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:40.117755 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-821f80fd-5c9b-4285-9a72-6e528458f662 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:40.118231 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-821f80fd-5c9b-4285-9a72-6e528458f662 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:40.246869 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-821f80fd-5c9b-4285-9a72-6e528458f662 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a993f5d14b64fccad723abecfcadf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b1be8431b0434d8bd6abca293127d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:04:40.254215 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-821f80fd-5c9b-4285-9a72-6e528458f662 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] 10.222.0.17 "GET /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755" status: 200 len: 1677 microversion: 2.1 time: 0.148902 Jun 16 23:04:40.254806 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 276/544] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:04:40 2022] GET /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755 => generated 1677 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:04:40.798628 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [req-f06cc194-3157-4d57-b1f5-0930dcfdca2d req-348e9b34-1718-4670-9ddb-803695611c74 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8", "tag": "823b7d46-8462-4945-943b-09a9fc1c8dce"}]} {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 23:04:40.807683 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-f06cc194-3157-4d57-b1f5-0930dcfdca2d req-348e9b34-1718-4670-9ddb-803695611c74 service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:40.808313 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-f06cc194-3157-4d57-b1f5-0930dcfdca2d req-348e9b34-1718-4670-9ddb-803695611c74 service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:40.819382 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.compute.server_external_events [req-f06cc194-3157-4d57-b1f5-0930dcfdca2d req-348e9b34-1718-4670-9ddb-803695611c74 service nova] Creating event network-changed:823b7d46-8462-4945-943b-09a9fc1c8dce for instance 8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8 on hv-cinder-84623 Jun 16 23:04:40.824671 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [req-f06cc194-3157-4d57-b1f5-0930dcfdca2d req-348e9b34-1718-4670-9ddb-803695611c74 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030867 Jun 16 23:04:40.825267 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 269/545] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 23:04:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 23:04:40.851148 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-6c17b1a7-7d3e-4f29-8c75-77cefee1f8a2 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:04:40.852224 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-6c17b1a7-7d3e-4f29-8c75-77cefee1f8a2 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] [instance: 5cfd118b-cc42-4dbe-93f1-784454892318] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:04:40.858794 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-6c17b1a7-7d3e-4f29-8c75-77cefee1f8a2 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:40.859388 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-6c17b1a7-7d3e-4f29-8c75-77cefee1f8a2 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:40.860149 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-6c17b1a7-7d3e-4f29-8c75-77cefee1f8a2 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:40.860655 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-6c17b1a7-7d3e-4f29-8c75-77cefee1f8a2 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:40.891723 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-6c17b1a7-7d3e-4f29-8c75-77cefee1f8a2 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] 10.222.0.17 "GET /compute/v2.1/servers/5cfd118b-cc42-4dbe-93f1-784454892318/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045379 Jun 16 23:04:40.892274 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 277/546] 10.222.0.17 () {58 vars in 1301 bytes} [Thu Jun 16 23:04:40 2022] GET /compute/v2.1/servers/5cfd118b-cc42-4dbe-93f1-784454892318/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 23:04:41.272250 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-7543b224-c087-423c-bdc2-6ebf9f59af94 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:04:41.272865 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-7543b224-c087-423c-bdc2-6ebf9f59af94 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] [instance: f4c73822-1dfa-4eed-bf02-1123b0402755] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:04:41.279676 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-7543b224-c087-423c-bdc2-6ebf9f59af94 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:41.280123 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-7543b224-c087-423c-bdc2-6ebf9f59af94 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:41.280954 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-7543b224-c087-423c-bdc2-6ebf9f59af94 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:41.281387 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-7543b224-c087-423c-bdc2-6ebf9f59af94 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:41.409691 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-7543b224-c087-423c-bdc2-6ebf9f59af94 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a993f5d14b64fccad723abecfcadf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b1be8431b0434d8bd6abca293127d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:04:41.417975 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-7543b224-c087-423c-bdc2-6ebf9f59af94 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] 10.222.0.17 "GET /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755" status: 200 len: 1654 microversion: 2.1 time: 0.149929 Jun 16 23:04:41.418644 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 270/547] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:04:41 2022] GET /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755 => generated 1654 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:04:41.434695 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-3f831e34-81ea-4d93-91fb-77b2e6e348bf tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 23:04:41.441119 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-3f831e34-81ea-4d93-91fb-77b2e6e348bf tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:41.441563 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-3f831e34-81ea-4d93-91fb-77b2e6e348bf tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:41.469135 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-3f831e34-81ea-4d93-91fb-77b2e6e348bf tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] [instance: f4c73822-1dfa-4eed-bf02-1123b0402755] Going to try to start instance {{(pid=117562) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 16 23:04:41.515697 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-3f831e34-81ea-4d93-91fb-77b2e6e348bf tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] 10.222.0.17 "POST /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755/action" status: 202 len: 0 microversion: 2.1 time: 0.084710 Jun 16 23:04:41.516322 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 278/548] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Jun 16 23:04:41 2022] POST /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 23:04:41.524204 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-7a49b405-e277-4beb-9104-ee83f2cdc033 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:04:41.524744 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-7a49b405-e277-4beb-9104-ee83f2cdc033 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] [instance: f4c73822-1dfa-4eed-bf02-1123b0402755] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:04:41.530648 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-7a49b405-e277-4beb-9104-ee83f2cdc033 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:41.531096 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-7a49b405-e277-4beb-9104-ee83f2cdc033 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:41.531882 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-7a49b405-e277-4beb-9104-ee83f2cdc033 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:41.532315 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-7a49b405-e277-4beb-9104-ee83f2cdc033 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:41.654980 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-7a49b405-e277-4beb-9104-ee83f2cdc033 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a993f5d14b64fccad723abecfcadf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b1be8431b0434d8bd6abca293127d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:04:41.662404 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-7a49b405-e277-4beb-9104-ee83f2cdc033 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] 10.222.0.17 "GET /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755" status: 200 len: 1663 microversion: 2.1 time: 0.141974 Jun 16 23:04:41.662996 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 271/549] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:04:41 2022] GET /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755 => generated 1663 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:04:41.903960 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-f5029771-7914-4cbe-aa34-13f66dca885d tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:04:41.905011 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-f5029771-7914-4cbe-aa34-13f66dca885d tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] [instance: 5cfd118b-cc42-4dbe-93f1-784454892318] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:04:41.911105 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-f5029771-7914-4cbe-aa34-13f66dca885d tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:41.911558 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-f5029771-7914-4cbe-aa34-13f66dca885d tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:41.912314 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-f5029771-7914-4cbe-aa34-13f66dca885d tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:41.912746 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-f5029771-7914-4cbe-aa34-13f66dca885d tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:41.942172 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-f5029771-7914-4cbe-aa34-13f66dca885d tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] 10.222.0.17 "GET /compute/v2.1/servers/5cfd118b-cc42-4dbe-93f1-784454892318/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042520 Jun 16 23:04:41.942758 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 279/550] 10.222.0.17 () {58 vars in 1301 bytes} [Thu Jun 16 23:04:41 2022] GET /compute/v2.1/servers/5cfd118b-cc42-4dbe-93f1-784454892318/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 23:04:42.679450 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-f20cc8c9-b40d-42be-ba92-77187b74a9d2 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:04:42.680092 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-f20cc8c9-b40d-42be-ba92-77187b74a9d2 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] [instance: f4c73822-1dfa-4eed-bf02-1123b0402755] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:04:42.686433 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-f20cc8c9-b40d-42be-ba92-77187b74a9d2 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:42.686914 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-f20cc8c9-b40d-42be-ba92-77187b74a9d2 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:42.687670 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-f20cc8c9-b40d-42be-ba92-77187b74a9d2 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:42.688102 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-f20cc8c9-b40d-42be-ba92-77187b74a9d2 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:42.813153 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-f20cc8c9-b40d-42be-ba92-77187b74a9d2 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a993f5d14b64fccad723abecfcadf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b1be8431b0434d8bd6abca293127d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:04:42.820456 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-f20cc8c9-b40d-42be-ba92-77187b74a9d2 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] 10.222.0.17 "GET /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755" status: 200 len: 1663 microversion: 2.1 time: 0.144828 Jun 16 23:04:42.821014 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 272/551] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:04:42 2022] GET /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755 => generated 1663 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:04:42.955098 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-b4bf0694-663f-4e33-88ae-bba2005206f5 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:04:42.956191 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-b4bf0694-663f-4e33-88ae-bba2005206f5 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] [instance: 5cfd118b-cc42-4dbe-93f1-784454892318] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:04:42.962636 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-b4bf0694-663f-4e33-88ae-bba2005206f5 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:42.963084 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-b4bf0694-663f-4e33-88ae-bba2005206f5 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:42.963983 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-b4bf0694-663f-4e33-88ae-bba2005206f5 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:42.964683 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-b4bf0694-663f-4e33-88ae-bba2005206f5 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:43.000236 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-b4bf0694-663f-4e33-88ae-bba2005206f5 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] 10.222.0.17 "GET /compute/v2.1/servers/5cfd118b-cc42-4dbe-93f1-784454892318/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050070 Jun 16 23:04:43.000810 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 280/552] 10.222.0.17 () {58 vars in 1301 bytes} [Thu Jun 16 23:04:42 2022] GET /compute/v2.1/servers/5cfd118b-cc42-4dbe-93f1-784454892318/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 23:04:43.837215 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-330472fd-0061-4b31-a9fa-353a60522efd tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:04:43.837822 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-330472fd-0061-4b31-a9fa-353a60522efd tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] [instance: f4c73822-1dfa-4eed-bf02-1123b0402755] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:04:43.845170 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-330472fd-0061-4b31-a9fa-353a60522efd tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:43.845559 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-330472fd-0061-4b31-a9fa-353a60522efd tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:43.846331 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-330472fd-0061-4b31-a9fa-353a60522efd tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:43.846804 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-330472fd-0061-4b31-a9fa-353a60522efd tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:44.011735 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-971e6f87-1d21-4097-8e2c-481bba54785e tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:04:44.012670 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-971e6f87-1d21-4097-8e2c-481bba54785e tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] [instance: 5cfd118b-cc42-4dbe-93f1-784454892318] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:04:44.021664 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-330472fd-0061-4b31-a9fa-353a60522efd tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a993f5d14b64fccad723abecfcadf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b1be8431b0434d8bd6abca293127d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:04:44.022135 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-971e6f87-1d21-4097-8e2c-481bba54785e tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:44.022612 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-971e6f87-1d21-4097-8e2c-481bba54785e tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:44.023412 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-971e6f87-1d21-4097-8e2c-481bba54785e tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:44.023857 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-971e6f87-1d21-4097-8e2c-481bba54785e tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:44.031169 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-330472fd-0061-4b31-a9fa-353a60522efd tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] 10.222.0.17 "GET /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755" status: 200 len: 1663 microversion: 2.1 time: 0.197674 Jun 16 23:04:44.031750 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 273/553] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:04:43 2022] GET /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755 => generated 1663 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:04:44.047135 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG dbcounter [-] [117562] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 23:04:44.075067 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-971e6f87-1d21-4097-8e2c-481bba54785e tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] 10.222.0.17 "GET /compute/v2.1/servers/5cfd118b-cc42-4dbe-93f1-784454892318/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067012 Jun 16 23:04:44.076229 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 281/554] 10.222.0.17 () {58 vars in 1301 bytes} [Thu Jun 16 23:04:44 2022] GET /compute/v2.1/servers/5cfd118b-cc42-4dbe-93f1-784454892318/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 23:04:45.048574 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-3f3b14b9-db99-42cc-b0ac-df4a9a54508b tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:04:45.049109 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-3f3b14b9-db99-42cc-b0ac-df4a9a54508b tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] [instance: f4c73822-1dfa-4eed-bf02-1123b0402755] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:04:45.051558 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG dbcounter [-] [117563] Writing DB stats nova_api:SELECT=91,nova_api:DELETE=1 {{(pid=117563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 23:04:45.056714 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-3f3b14b9-db99-42cc-b0ac-df4a9a54508b tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:45.057166 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-3f3b14b9-db99-42cc-b0ac-df4a9a54508b tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:45.058614 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-3f3b14b9-db99-42cc-b0ac-df4a9a54508b tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:45.059048 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-3f3b14b9-db99-42cc-b0ac-df4a9a54508b tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:45.087750 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-b16dd7ea-2d12-419b-a7a8-bcf866a93e06 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:04:45.088756 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-b16dd7ea-2d12-419b-a7a8-bcf866a93e06 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] [instance: 5cfd118b-cc42-4dbe-93f1-784454892318] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:04:45.096376 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-b16dd7ea-2d12-419b-a7a8-bcf866a93e06 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:45.096821 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-b16dd7ea-2d12-419b-a7a8-bcf866a93e06 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:45.097789 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-b16dd7ea-2d12-419b-a7a8-bcf866a93e06 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:45.098381 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-b16dd7ea-2d12-419b-a7a8-bcf866a93e06 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:45.132127 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-b16dd7ea-2d12-419b-a7a8-bcf866a93e06 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] 10.222.0.17 "GET /compute/v2.1/servers/5cfd118b-cc42-4dbe-93f1-784454892318/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048525 Jun 16 23:04:45.132679 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 282/555] 10.222.0.17 () {58 vars in 1301 bytes} [Thu Jun 16 23:04:45 2022] GET /compute/v2.1/servers/5cfd118b-cc42-4dbe-93f1-784454892318/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 16 23:04:45.196017 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-cc313f7f-053a-494f-a62d-cddef899c18e tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:04:45.196761 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-cc313f7f-053a-494f-a62d-cddef899c18e tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] [instance: 5cfd118b-cc42-4dbe-93f1-784454892318] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:04:45.204065 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-cc313f7f-053a-494f-a62d-cddef899c18e tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:45.205185 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-cc313f7f-053a-494f-a62d-cddef899c18e tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:45.206413 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-cc313f7f-053a-494f-a62d-cddef899c18e tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:45.206895 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-cc313f7f-053a-494f-a62d-cddef899c18e tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:45.210525 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-3f3b14b9-db99-42cc-b0ac-df4a9a54508b tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a993f5d14b64fccad723abecfcadf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b1be8431b0434d8bd6abca293127d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:04:45.214672 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG dbcounter [-] [117563] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 23:04:45.220035 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-3f3b14b9-db99-42cc-b0ac-df4a9a54508b tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] 10.222.0.17 "GET /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755" status: 200 len: 1663 microversion: 2.1 time: 0.175337 Jun 16 23:04:45.220936 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 274/556] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:04:45 2022] GET /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755 => generated 1663 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:04:45.241465 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-cc313f7f-053a-494f-a62d-cddef899c18e tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] [instance: 5cfd118b-cc42-4dbe-93f1-784454892318] Going to try to terminate instance {{(pid=117562) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 23:04:45.318036 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-cc313f7f-053a-494f-a62d-cddef899c18e tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] 10.222.0.17 "DELETE /compute/v2.1/servers/5cfd118b-cc42-4dbe-93f1-784454892318" status: 204 len: 0 microversion: 2.1 time: 0.125525 Jun 16 23:04:45.318555 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 283/557] 10.222.0.17 () {58 vars in 1238 bytes} [Thu Jun 16 23:04:45 2022] DELETE /compute/v2.1/servers/5cfd118b-cc42-4dbe-93f1-784454892318 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 16 23:04:45.326570 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-dcc06bac-dc0a-4ac6-8c00-dc3692bfe0e3 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:04:45.327209 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-dcc06bac-dc0a-4ac6-8c00-dc3692bfe0e3 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] [instance: 5cfd118b-cc42-4dbe-93f1-784454892318] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:04:45.334512 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-dcc06bac-dc0a-4ac6-8c00-dc3692bfe0e3 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:45.334989 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-dcc06bac-dc0a-4ac6-8c00-dc3692bfe0e3 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:45.335758 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-dcc06bac-dc0a-4ac6-8c00-dc3692bfe0e3 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:45.336513 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-dcc06bac-dc0a-4ac6-8c00-dc3692bfe0e3 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:45.471184 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-dcc06bac-dc0a-4ac6-8c00-dc3692bfe0e3 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3a2d16133b4af8a208682de8a7d111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0526c12e8bc947209e24daf5ddfad7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:04:45.478630 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-dcc06bac-dc0a-4ac6-8c00-dc3692bfe0e3 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] 10.222.0.17 "GET /compute/v2.1/servers/5cfd118b-cc42-4dbe-93f1-784454892318" status: 200 len: 1681 microversion: 2.1 time: 0.155833 Jun 16 23:04:45.479812 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 275/558] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:04:45 2022] GET /compute/v2.1/servers/5cfd118b-cc42-4dbe-93f1-784454892318 => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:04:46.240152 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-4570ee4d-3335-4bc2-9b77-f8db5db707a7 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:04:46.240853 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-4570ee4d-3335-4bc2-9b77-f8db5db707a7 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] [instance: f4c73822-1dfa-4eed-bf02-1123b0402755] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:04:46.247855 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-4570ee4d-3335-4bc2-9b77-f8db5db707a7 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:46.248302 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-4570ee4d-3335-4bc2-9b77-f8db5db707a7 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:46.249072 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-4570ee4d-3335-4bc2-9b77-f8db5db707a7 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:46.249509 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-4570ee4d-3335-4bc2-9b77-f8db5db707a7 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:46.381667 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-4570ee4d-3335-4bc2-9b77-f8db5db707a7 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a993f5d14b64fccad723abecfcadf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b1be8431b0434d8bd6abca293127d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:04:46.389103 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-4570ee4d-3335-4bc2-9b77-f8db5db707a7 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] 10.222.0.17 "GET /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755" status: 200 len: 1663 microversion: 2.1 time: 0.153230 Jun 16 23:04:46.389666 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 284/559] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:04:46 2022] GET /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755 => generated 1663 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:04:46.496845 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-17cea9e5-d433-410d-9cbd-a1627535e9d1 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:04:46.497386 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-17cea9e5-d433-410d-9cbd-a1627535e9d1 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] [instance: 5cfd118b-cc42-4dbe-93f1-784454892318] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:04:46.503854 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-17cea9e5-d433-410d-9cbd-a1627535e9d1 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:46.504306 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-17cea9e5-d433-410d-9cbd-a1627535e9d1 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:46.505071 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-17cea9e5-d433-410d-9cbd-a1627535e9d1 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:46.505510 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-17cea9e5-d433-410d-9cbd-a1627535e9d1 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:46.633355 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-17cea9e5-d433-410d-9cbd-a1627535e9d1 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3a2d16133b4af8a208682de8a7d111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0526c12e8bc947209e24daf5ddfad7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:04:46.640842 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-17cea9e5-d433-410d-9cbd-a1627535e9d1 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] 10.222.0.17 "GET /compute/v2.1/servers/5cfd118b-cc42-4dbe-93f1-784454892318" status: 200 len: 1681 microversion: 2.1 time: 0.148575 Jun 16 23:04:46.641413 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 276/560] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:04:46 2022] GET /compute/v2.1/servers/5cfd118b-cc42-4dbe-93f1-784454892318 => generated 1681 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:04:47.406418 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-1d61456d-f8ab-463a-aba1-da3a55bb6d38 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:04:47.407076 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-1d61456d-f8ab-463a-aba1-da3a55bb6d38 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] [instance: f4c73822-1dfa-4eed-bf02-1123b0402755] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:04:47.413480 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-1d61456d-f8ab-463a-aba1-da3a55bb6d38 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:47.413934 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-1d61456d-f8ab-463a-aba1-da3a55bb6d38 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:47.414723 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-1d61456d-f8ab-463a-aba1-da3a55bb6d38 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:47.415164 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-1d61456d-f8ab-463a-aba1-da3a55bb6d38 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:47.543862 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-1d61456d-f8ab-463a-aba1-da3a55bb6d38 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a993f5d14b64fccad723abecfcadf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b1be8431b0434d8bd6abca293127d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:04:47.551236 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-1d61456d-f8ab-463a-aba1-da3a55bb6d38 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] 10.222.0.17 "GET /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755" status: 200 len: 1663 microversion: 2.1 time: 0.148641 Jun 16 23:04:47.551793 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 285/561] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:04:47 2022] GET /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755 => generated 1663 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:04:47.656873 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-58d92d5d-859a-4806-bdb1-1751090238a2 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:04:47.657477 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-58d92d5d-859a-4806-bdb1-1751090238a2 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] [instance: 5cfd118b-cc42-4dbe-93f1-784454892318] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:04:47.663964 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-58d92d5d-859a-4806-bdb1-1751090238a2 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:47.664414 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-58d92d5d-859a-4806-bdb1-1751090238a2 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:47.665175 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-58d92d5d-859a-4806-bdb1-1751090238a2 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:47.665610 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-58d92d5d-859a-4806-bdb1-1751090238a2 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:47.792997 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-58d92d5d-859a-4806-bdb1-1751090238a2 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3a2d16133b4af8a208682de8a7d111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0526c12e8bc947209e24daf5ddfad7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:04:47.800479 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-58d92d5d-859a-4806-bdb1-1751090238a2 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] 10.222.0.17 "GET /compute/v2.1/servers/5cfd118b-cc42-4dbe-93f1-784454892318" status: 200 len: 1681 microversion: 2.1 time: 0.147384 Jun 16 23:04:47.801043 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 277/562] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:04:47 2022] GET /compute/v2.1/servers/5cfd118b-cc42-4dbe-93f1-784454892318 => generated 1681 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:04:48.568851 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-fb9dcf13-2ba7-4d21-8208-dccb82aa16c1 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:04:48.569360 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-fb9dcf13-2ba7-4d21-8208-dccb82aa16c1 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] [instance: f4c73822-1dfa-4eed-bf02-1123b0402755] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:04:48.576466 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-fb9dcf13-2ba7-4d21-8208-dccb82aa16c1 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:48.576911 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-fb9dcf13-2ba7-4d21-8208-dccb82aa16c1 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:48.577851 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-fb9dcf13-2ba7-4d21-8208-dccb82aa16c1 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:48.578286 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-fb9dcf13-2ba7-4d21-8208-dccb82aa16c1 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:48.704037 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-fb9dcf13-2ba7-4d21-8208-dccb82aa16c1 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a993f5d14b64fccad723abecfcadf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b1be8431b0434d8bd6abca293127d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:04:48.711443 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-fb9dcf13-2ba7-4d21-8208-dccb82aa16c1 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] 10.222.0.17 "GET /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755" status: 200 len: 1663 microversion: 2.1 time: 0.146577 Jun 16 23:04:48.712002 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 286/563] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:04:48 2022] GET /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755 => generated 1663 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:04:48.818219 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-1c3587e8-3b3a-4868-bdcf-cf599600dbf9 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:04:48.818902 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-1c3587e8-3b3a-4868-bdcf-cf599600dbf9 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] [instance: 5cfd118b-cc42-4dbe-93f1-784454892318] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:04:48.825261 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-1c3587e8-3b3a-4868-bdcf-cf599600dbf9 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:48.825713 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-1c3587e8-3b3a-4868-bdcf-cf599600dbf9 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:48.826486 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-1c3587e8-3b3a-4868-bdcf-cf599600dbf9 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:48.826947 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-1c3587e8-3b3a-4868-bdcf-cf599600dbf9 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:48.965009 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-1c3587e8-3b3a-4868-bdcf-cf599600dbf9 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3a2d16133b4af8a208682de8a7d111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0526c12e8bc947209e24daf5ddfad7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:04:48.972458 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-1c3587e8-3b3a-4868-bdcf-cf599600dbf9 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] 10.222.0.17 "GET /compute/v2.1/servers/5cfd118b-cc42-4dbe-93f1-784454892318" status: 200 len: 1681 microversion: 2.1 time: 0.158031 Jun 16 23:04:48.973022 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 278/564] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:04:48 2022] GET /compute/v2.1/servers/5cfd118b-cc42-4dbe-93f1-784454892318 => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:04:49.728526 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-b344d6ae-54a4-4a8f-844a-e7fea80912a2 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:04:49.729682 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-b344d6ae-54a4-4a8f-844a-e7fea80912a2 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] [instance: f4c73822-1dfa-4eed-bf02-1123b0402755] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:04:49.736167 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-b344d6ae-54a4-4a8f-844a-e7fea80912a2 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:49.736615 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-b344d6ae-54a4-4a8f-844a-e7fea80912a2 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:49.737372 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-b344d6ae-54a4-4a8f-844a-e7fea80912a2 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:49.737805 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-b344d6ae-54a4-4a8f-844a-e7fea80912a2 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:49.867436 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-b344d6ae-54a4-4a8f-844a-e7fea80912a2 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a993f5d14b64fccad723abecfcadf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b1be8431b0434d8bd6abca293127d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:04:49.874764 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-b344d6ae-54a4-4a8f-844a-e7fea80912a2 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] 10.222.0.17 "GET /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755" status: 200 len: 1663 microversion: 2.1 time: 0.149980 Jun 16 23:04:49.875319 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 287/565] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:04:49 2022] GET /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755 => generated 1663 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:04:49.989354 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-f7be4530-7c7c-44cc-9707-cbdeb3219c2d tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:04:49.989883 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-f7be4530-7c7c-44cc-9707-cbdeb3219c2d tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] [instance: 5cfd118b-cc42-4dbe-93f1-784454892318] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:04:49.996989 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-f7be4530-7c7c-44cc-9707-cbdeb3219c2d tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:49.997428 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-f7be4530-7c7c-44cc-9707-cbdeb3219c2d tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:49.998177 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-f7be4530-7c7c-44cc-9707-cbdeb3219c2d tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:49.998625 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-f7be4530-7c7c-44cc-9707-cbdeb3219c2d tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:50.126342 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-f7be4530-7c7c-44cc-9707-cbdeb3219c2d tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3a2d16133b4af8a208682de8a7d111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0526c12e8bc947209e24daf5ddfad7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:04:50.135401 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-f7be4530-7c7c-44cc-9707-cbdeb3219c2d tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] 10.222.0.17 "GET /compute/v2.1/servers/5cfd118b-cc42-4dbe-93f1-784454892318" status: 200 len: 1681 microversion: 2.1 time: 0.149476 Jun 16 23:04:50.135961 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 279/566] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:04:49 2022] GET /compute/v2.1/servers/5cfd118b-cc42-4dbe-93f1-784454892318 => generated 1681 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:04:50.891110 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-3e8603b6-1f44-47fc-8bf2-7da6277b06fa tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:04:50.891711 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-3e8603b6-1f44-47fc-8bf2-7da6277b06fa tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] [instance: f4c73822-1dfa-4eed-bf02-1123b0402755] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:04:50.898191 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-3e8603b6-1f44-47fc-8bf2-7da6277b06fa tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:50.898674 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-3e8603b6-1f44-47fc-8bf2-7da6277b06fa tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:50.899436 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-3e8603b6-1f44-47fc-8bf2-7da6277b06fa tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:50.899868 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-3e8603b6-1f44-47fc-8bf2-7da6277b06fa tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:51.094946 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-3e8603b6-1f44-47fc-8bf2-7da6277b06fa tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a993f5d14b64fccad723abecfcadf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b1be8431b0434d8bd6abca293127d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:04:51.102366 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-3e8603b6-1f44-47fc-8bf2-7da6277b06fa tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] 10.222.0.17 "GET /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755" status: 200 len: 1667 microversion: 2.1 time: 0.215070 Jun 16 23:04:51.103029 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 288/567] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:04:50 2022] GET /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755 => generated 1667 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 23:04:51.153077 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-5fb9e79a-c04d-4c89-84dc-c94adc435484 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:04:51.153688 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-5fb9e79a-c04d-4c89-84dc-c94adc435484 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] [instance: 5cfd118b-cc42-4dbe-93f1-784454892318] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:04:51.160235 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-5fb9e79a-c04d-4c89-84dc-c94adc435484 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:51.160687 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-5fb9e79a-c04d-4c89-84dc-c94adc435484 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:51.161456 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-5fb9e79a-c04d-4c89-84dc-c94adc435484 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:51.161938 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-5fb9e79a-c04d-4c89-84dc-c94adc435484 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:51.227546 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-5fb9e79a-c04d-4c89-84dc-c94adc435484 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3a2d16133b4af8a208682de8a7d111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0526c12e8bc947209e24daf5ddfad7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:04:51.235397 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-5fb9e79a-c04d-4c89-84dc-c94adc435484 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] 10.222.0.17 "GET /compute/v2.1/servers/5cfd118b-cc42-4dbe-93f1-784454892318" status: 200 len: 1614 microversion: 2.1 time: 0.086665 Jun 16 23:04:51.236160 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 280/568] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:04:51 2022] GET /compute/v2.1/servers/5cfd118b-cc42-4dbe-93f1-784454892318 => generated 1614 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:04:51.393287 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [req-6f1bccc1-a454-4696-b7e5-14f5a4cc1ff3 req-78aa6a2a-f1e1-45d4-b9a4-fe8b09b0eca1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5cfd118b-cc42-4dbe-93f1-784454892318", "name": "network-vif-deleted", "tag": "cdc1a373-1b2c-4326-9d15-b3c2fc92a365"}]} {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 23:04:51.400539 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG dbcounter [-] [117562] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=117562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 23:04:51.402361 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [req-6f1bccc1-a454-4696-b7e5-14f5a4cc1ff3 req-78aa6a2a-f1e1-45d4-b9a4-fe8b09b0eca1 service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:51.403264 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [req-6f1bccc1-a454-4696-b7e5-14f5a4cc1ff3 req-78aa6a2a-f1e1-45d4-b9a4-fe8b09b0eca1 service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:51.421901 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.compute.server_external_events [req-6f1bccc1-a454-4696-b7e5-14f5a4cc1ff3 req-78aa6a2a-f1e1-45d4-b9a4-fe8b09b0eca1 service nova] Creating event network-vif-deleted:cdc1a373-1b2c-4326-9d15-b3c2fc92a365 for instance 5cfd118b-cc42-4dbe-93f1-784454892318 on hv-cinder-84623 Jun 16 23:04:51.427011 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [req-6f1bccc1-a454-4696-b7e5-14f5a4cc1ff3 req-78aa6a2a-f1e1-45d4-b9a4-fe8b09b0eca1 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037254 Jun 16 23:04:51.427797 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 289/569] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 23:04:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 23:04:52.252735 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-1681c686-05b5-439d-b317-f74656580897 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:04:52.253532 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-1681c686-05b5-439d-b317-f74656580897 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] [instance: 5cfd118b-cc42-4dbe-93f1-784454892318] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:04:52.267195 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-1681c686-05b5-439d-b317-f74656580897 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:52.267644 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-1681c686-05b5-439d-b317-f74656580897 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:52.268422 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-1681c686-05b5-439d-b317-f74656580897 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:52.268868 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-1681c686-05b5-439d-b317-f74656580897 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:52.282795 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.wsgi [None req-1681c686-05b5-439d-b317-f74656580897 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] HTTP exception thrown: Instance 5cfd118b-cc42-4dbe-93f1-784454892318 could not be found. Jun 16 23:04:52.284539 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-1681c686-05b5-439d-b317-f74656580897 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Request method failure captured: Jun 16 23:04:52.284539 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: request: GET /compute/v2.1/servers/5cfd118b-cc42-4dbe-93f1-784454892318 HTTP/1.1 Jun 16 23:04:52.284539 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Accept: application/json Jun 16 23:04:52.284539 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Accept-Encoding: identity Jun 16 23:04:52.284539 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Connection: close Jun 16 23:04:52.284539 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Content-Length: 0 Jun 16 23:04:52.284539 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Content-Type: application/json Jun 16 23:04:52.284539 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Host: 10.222.0.17 Jun 16 23:04:52.284539 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Openstack-System-Scope: None Jun 16 23:04:52.284539 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: User-Agent: python-urllib3/1.26.9 Jun 16 23:04:52.284539 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Auth-Token: gAAAAABiq7YeRQnlz8l2GSIF0VOET6Y1W8yBB5oz1cYYpYFcfT7cYY0kIvo4O2qRVrDvagXVbkghr-k-KGb8GCGo_mbQOK1vAXciruDemULKCP_QAI9xPZafRW81TxgAIAvJEx6CPJUGbCIq4SyYsx25OB1SZXBFh8aRZWpbG6CQ65KEZvQlgIo Jun 16 23:04:52.284539 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Domain-Id: None Jun 16 23:04:52.284539 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Domain-Name: None Jun 16 23:04:52.284539 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Identity-Status: Confirmed Jun 16 23:04:52.284539 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Is-Admin-Project: True Jun 16 23:04:52.284539 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Project-Domain-Id: default Jun 16 23:04:52.284539 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Project-Domain-Name: Default Jun 16 23:04:52.284539 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Project-Id: 0526c12e8bc947209e24daf5ddfad7be Jun 16 23:04:52.284539 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Project-Name: tempest-AttachVolumeNegativeTest-1967724585 Jun 16 23:04:52.284539 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Role: member,reader Jun 16 23:04:52.284539 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Roles: member,reader Jun 16 23:04:52.286095 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/0526c12e8bc947209e24daf5ddfad7be"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_0526c12e8bc947209e24daf5ddfad7be"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0526c12e8bc947209e24daf5ddfad7be"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0526c12e8bc947209e24daf5ddfad7be"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Jun 16 23:04:52.286095 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Tenant: tempest-AttachVolumeNegativeTest-1967724585 Jun 16 23:04:52.286095 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Tenant-Id: 0526c12e8bc947209e24daf5ddfad7be Jun 16 23:04:52.286095 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1967724585 Jun 16 23:04:52.286095 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-User: tempest-AttachVolumeNegativeTest-1967724585-project Jun 16 23:04:52.286095 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-User-Domain-Id: default Jun 16 23:04:52.286095 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-User-Domain-Name: Default Jun 16 23:04:52.286095 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-User-Id: 9e3a2d16133b4af8a208682de8a7d111 Jun 16 23:04:52.286095 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-User-Name: tempest-AttachVolumeNegativeTest-1967724585-project Jun 16 23:04:52.286095 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: method: > Jun 16 23:04:52.286095 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: exception: Instance 5cfd118b-cc42-4dbe-93f1-784454892318 could not be found. Jun 16 23:04:52.286095 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: action_args: {'id': '5cfd118b-cc42-4dbe-93f1-784454892318'} Jun 16 23:04:52.287085 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 23:04:52.287085 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 23:04:52.287085 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 23:04:52.287085 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 23:04:52.287085 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 23:04:52.287085 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 23:04:52.287085 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 23:04:52.287085 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 23:04:52.287085 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 23:04:52.287085 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 23:04:52.287085 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5cfd118b-cc42-4dbe-93f1-784454892318 could not be found. Jun 16 23:04:52.287085 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 16 23:04:52.287085 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 23:04:52.287085 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 16 23:04:52.287085 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 23:04:52.287085 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 23:04:52.287085 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 23:04:52.287085 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 23:04:52.287085 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 23:04:52.287085 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 23:04:52.288509 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 23:04:52.288509 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 23:04:52.288509 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 23:04:52.288509 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 23:04:52.288509 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 23:04:52.288509 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 23:04:52.288509 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 23:04:52.288509 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5cfd118b-cc42-4dbe-93f1-784454892318 could not be found. Jun 16 23:04:52.288509 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 16 23:04:52.288509 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 23:04:52.288509 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 16 23:04:52.288509 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 23:04:52.288509 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 23:04:52.288509 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 23:04:52.288509 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 23:04:52.288509 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 23:04:52.288509 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5cfd118b-cc42-4dbe-93f1-784454892318 could not be found. Jun 16 23:04:52.288509 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 16 23:04:52.289951 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-1681c686-05b5-439d-b317-f74656580897 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Returning 404 to user: Instance 5cfd118b-cc42-4dbe-93f1-784454892318 could not be found. {{(pid=117563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 23:04:52.289951 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-1681c686-05b5-439d-b317-f74656580897 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] 10.222.0.17 "GET /compute/v2.1/servers/5cfd118b-cc42-4dbe-93f1-784454892318" status: 404 len: 111 microversion: 2.1 time: 0.037086 Jun 16 23:04:52.289951 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 281/570] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:04:52 2022] GET /compute/v2.1/servers/5cfd118b-cc42-4dbe-93f1-784454892318 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 23:04:52.297017 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-a59019a0-1db7-423c-85ff-155701c01a53 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Calling method '.version_select at 0x7f5313e0a700>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:04:52.316345 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-a59019a0-1db7-423c-85ff-155701c01a53 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1671851097" status: 202 len: 0 microversion: 2.1 time: 0.024422 Jun 16 23:04:52.316894 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 290/571] 10.222.0.17 () {58 vars in 1220 bytes} [Thu Jun 16 23:04:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1671851097 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 23:04:52.702438 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-f3ab4250-3bcd-4258-a318-5bf7be8738a8 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:04:52.703013 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-f3ab4250-3bcd-4258-a318-5bf7be8738a8 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] [instance: 85395b04-657c-4595-83ca-b6a1635f6daa] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:04:52.708975 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-f3ab4250-3bcd-4258-a318-5bf7be8738a8 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:52.709506 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-f3ab4250-3bcd-4258-a318-5bf7be8738a8 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:52.710324 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-f3ab4250-3bcd-4258-a318-5bf7be8738a8 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:52.711036 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-f3ab4250-3bcd-4258-a318-5bf7be8738a8 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:52.795489 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.objects.instance [None req-f3ab4250-3bcd-4258-a318-5bf7be8738a8 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Lazy-loading 'services' on Instance uuid 85395b04-657c-4595-83ca-b6a1635f6daa {{(pid=117563) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 23:04:52.872678 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-f3ab4250-3bcd-4258-a318-5bf7be8738a8 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] 10.222.0.17 "DELETE /compute/v2.1/servers/85395b04-657c-4595-83ca-b6a1635f6daa/os-volume_attachments/7257d5d0-a9fb-4dd3-9398-b555d51560d2" status: 202 len: 0 microversion: 2.1 time: 0.173931 Jun 16 23:04:52.873271 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 282/572] 10.222.0.17 () {58 vars in 1415 bytes} [Thu Jun 16 23:04:52 2022] DELETE /compute/v2.1/servers/85395b04-657c-4595-83ca-b6a1635f6daa/os-volume_attachments/7257d5d0-a9fb-4dd3-9398-b555d51560d2 => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 23:04:52.943232 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-2f9eb075-cb95-4042-b35d-dbc37aba1927 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Action: 'create', calling method: .version_select at 0x7f5313e26af0>, body: {"keypair": {"name": "tempest-keypair-226223852", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIvRl69pbyimL/vMDEw0wQW3yALU6ILmWPHTMNjTLjt1L7GCchueSzleeJ0uOs8cHT2U5fuveB8ePIRIALcsOjLKf7FeQqyyN7JltqU3b2fBGWbCD0m49DV5uLyacUAMwg=="}} {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 23:04:52.958800 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.quota [None req-2f9eb075-cb95-4042-b35d-dbc37aba1927 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Getting quotas for project 0526c12e8bc947209e24daf5ddfad7be. Resources: {'key_pairs'} {{(pid=117562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 23:04:52.962743 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.quota [None req-2f9eb075-cb95-4042-b35d-dbc37aba1927 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Getting quotas for user 9e3a2d16133b4af8a208682de8a7d111 and project 0526c12e8bc947209e24daf5ddfad7be. Resources: {'key_pairs'} {{(pid=117562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 23:04:52.987804 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-2f9eb075-cb95-4042-b35d-dbc37aba1927 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.048419 Jun 16 23:04:52.988439 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 291/573] 10.222.0.17 () {60 vars in 1158 bytes} [Thu Jun 16 23:04:52 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 23:04:53.206575 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-641c8e11-b5a0-47d5-8ae9-971ba5520549 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:04:53.207339 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-641c8e11-b5a0-47d5-8ae9-971ba5520549 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 46f43909-d681-4938-8253-5080b626e169] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:04:53.214360 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-641c8e11-b5a0-47d5-8ae9-971ba5520549 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:53.214866 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-641c8e11-b5a0-47d5-8ae9-971ba5520549 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:53.215631 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-641c8e11-b5a0-47d5-8ae9-971ba5520549 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:53.216059 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-641c8e11-b5a0-47d5-8ae9-971ba5520549 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:53.249752 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-641c8e11-b5a0-47d5-8ae9-971ba5520549 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169/os-volume_attachments/9962b4a2-a75f-4d66-aff4-0fd3ad9fff6f" status: 200 len: 194 microversion: 2.20 time: 0.047439 Jun 16 23:04:53.250226 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 283/574] 10.222.0.17 () {60 vars in 1453 bytes} [Thu Jun 16 23:04:53 2022] GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169/os-volume_attachments/9962b4a2-a75f-4d66-aff4-0fd3ad9fff6f => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 23:04:53.317609 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-ee17f96b-78b9-4bde-9f4a-4a8ed99ccef0 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:04:53.319402 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-ee17f96b-78b9-4bde-9f4a-4a8ed99ccef0 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 46f43909-d681-4938-8253-5080b626e169] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:04:53.325788 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-ee17f96b-78b9-4bde-9f4a-4a8ed99ccef0 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:53.326252 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-ee17f96b-78b9-4bde-9f4a-4a8ed99ccef0 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:53.327069 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-ee17f96b-78b9-4bde-9f4a-4a8ed99ccef0 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:53.327514 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-ee17f96b-78b9-4bde-9f4a-4a8ed99ccef0 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:53.417178 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.objects.instance [None req-ee17f96b-78b9-4bde-9f4a-4a8ed99ccef0 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lazy-loading 'services' on Instance uuid 46f43909-d681-4938-8253-5080b626e169 {{(pid=117562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 23:04:53.488569 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-ee17f96b-78b9-4bde-9f4a-4a8ed99ccef0 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "DELETE /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169/os-volume_attachments/9962b4a2-a75f-4d66-aff4-0fd3ad9fff6f" status: 202 len: 0 microversion: 2.20 time: 0.175421 Jun 16 23:04:53.489333 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 292/575] 10.222.0.17 () {60 vars in 1456 bytes} [Thu Jun 16 23:04:53 2022] DELETE /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169/os-volume_attachments/9962b4a2-a75f-4d66-aff4-0fd3ad9fff6f => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 16 23:04:53.498118 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-664708d5-be13-46ac-becf-6b71cdaa8e9e tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:04:53.499187 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-664708d5-be13-46ac-becf-6b71cdaa8e9e tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 46f43909-d681-4938-8253-5080b626e169] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:04:53.505581 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-664708d5-be13-46ac-becf-6b71cdaa8e9e tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:53.506403 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-664708d5-be13-46ac-becf-6b71cdaa8e9e tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:53.507320 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-664708d5-be13-46ac-becf-6b71cdaa8e9e tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:53.507991 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-664708d5-be13-46ac-becf-6b71cdaa8e9e tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:53.543286 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-664708d5-be13-46ac-becf-6b71cdaa8e9e tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049459 Jun 16 23:04:53.544025 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 284/576] 10.222.0.17 () {60 vars in 1342 bytes} [Thu Jun 16 23:04:53 2022] GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 23:04:53.992652 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-127af5df-0cfc-4379-9725-12b141b23cb7 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:04:53.993164 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-127af5df-0cfc-4379-9725-12b141b23cb7 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] [instance: 85395b04-657c-4595-83ca-b6a1635f6daa] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:04:53.999350 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-127af5df-0cfc-4379-9725-12b141b23cb7 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:53.999799 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-127af5df-0cfc-4379-9725-12b141b23cb7 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:54.000566 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-127af5df-0cfc-4379-9725-12b141b23cb7 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:54.001003 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-127af5df-0cfc-4379-9725-12b141b23cb7 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:54.026217 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-127af5df-0cfc-4379-9725-12b141b23cb7 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] [instance: 85395b04-657c-4595-83ca-b6a1635f6daa] Going to try to terminate instance {{(pid=117562) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 23:04:54.103752 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-127af5df-0cfc-4379-9725-12b141b23cb7 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] 10.222.0.17 "DELETE /compute/v2.1/servers/85395b04-657c-4595-83ca-b6a1635f6daa" status: 204 len: 0 microversion: 2.1 time: 0.115031 Jun 16 23:04:54.104420 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 293/577] 10.222.0.17 () {58 vars in 1238 bytes} [Thu Jun 16 23:04:53 2022] DELETE /compute/v2.1/servers/85395b04-657c-4595-83ca-b6a1635f6daa => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 23:04:54.112641 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-8bbd7d49-55f7-40cb-8938-c1d79a97111b tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:04:54.113386 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-8bbd7d49-55f7-40cb-8938-c1d79a97111b tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] [instance: 85395b04-657c-4595-83ca-b6a1635f6daa] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:04:54.119531 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-8bbd7d49-55f7-40cb-8938-c1d79a97111b tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:54.120244 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-8bbd7d49-55f7-40cb-8938-c1d79a97111b tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:54.121087 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-8bbd7d49-55f7-40cb-8938-c1d79a97111b tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:54.121597 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-8bbd7d49-55f7-40cb-8938-c1d79a97111b tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:54.280788 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-8bbd7d49-55f7-40cb-8938-c1d79a97111b tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69163c28aa75492aa01c70532bed15a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9761759a69724a21b0b9315a931b106f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:04:54.283346 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-fb254711-7bfe-4d66-99d7-17cbf9237e18 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1240496512", "imageRef": "2b486731-e5ea-4159-b6b1-ed0083e00543", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "663ca997-5122-4586-973b-ea2e3ed98672"}], "security_groups": [{"name": "tempest-securitygroup--343610367"}], "key_name": "tempest-keypair-226223852", "user_data": "}} {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 23:04:54.288397 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-8bbd7d49-55f7-40cb-8938-c1d79a97111b tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] 10.222.0.17 "GET /compute/v2.1/servers/85395b04-657c-4595-83ca-b6a1635f6daa" status: 200 len: 1515 microversion: 2.1 time: 0.179683 Jun 16 23:04:54.288965 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 285/578] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:04:54 2022] GET /compute/v2.1/servers/85395b04-657c-4595-83ca-b6a1635f6daa => generated 1515 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 23:04:54.382202 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.network.neutron [None req-fb254711-7bfe-4d66-99d7-17cbf9237e18 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] validate_networks() for [('663ca997-5122-4586-973b-ea2e3ed98672', None, None, None, None, None)] {{(pid=117562) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 23:04:54.555625 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-e7edb658-3935-433f-887e-ed84dbaf360a tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:04:54.557131 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-e7edb658-3935-433f-887e-ed84dbaf360a tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 46f43909-d681-4938-8253-5080b626e169] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:04:54.565018 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-e7edb658-3935-433f-887e-ed84dbaf360a tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:54.565400 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-e7edb658-3935-433f-887e-ed84dbaf360a tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:54.566178 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-e7edb658-3935-433f-887e-ed84dbaf360a tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:54.566641 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-e7edb658-3935-433f-887e-ed84dbaf360a tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:54.599165 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-e7edb658-3935-433f-887e-ed84dbaf360a tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047245 Jun 16 23:04:54.600000 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 286/579] 10.222.0.17 () {60 vars in 1342 bytes} [Thu Jun 16 23:04:54 2022] GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 16 23:04:54.740139 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.virt.hardware [None req-fb254711-7bfe-4d66-99d7-17cbf9237e18 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Flavor limits 0:0:0 {{(pid=117562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 23:04:54.740556 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.virt.hardware [None req-fb254711-7bfe-4d66-99d7-17cbf9237e18 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Image limits 0:0:0 {{(pid=117562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 23:04:54.741038 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.virt.hardware [None req-fb254711-7bfe-4d66-99d7-17cbf9237e18 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Flavor pref 0:0:0 {{(pid=117562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 23:04:54.741428 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.virt.hardware [None req-fb254711-7bfe-4d66-99d7-17cbf9237e18 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Image pref 0:0:0 {{(pid=117562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 23:04:54.741832 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.virt.hardware [None req-fb254711-7bfe-4d66-99d7-17cbf9237e18 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 23:04:54.751072 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-fb254711-7bfe-4d66-99d7-17cbf9237e18 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:54.751517 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-fb254711-7bfe-4d66-99d7-17cbf9237e18 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:54.752306 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-fb254711-7bfe-4d66-99d7-17cbf9237e18 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:54.752739 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-fb254711-7bfe-4d66-99d7-17cbf9237e18 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:54.769109 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.quota [None req-fb254711-7bfe-4d66-99d7-17cbf9237e18 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Getting quotas for project 0526c12e8bc947209e24daf5ddfad7be. Resources: {'instances', 'cores', 'ram'} {{(pid=117562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 23:04:54.772943 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.quota [None req-fb254711-7bfe-4d66-99d7-17cbf9237e18 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Getting quotas for user 9e3a2d16133b4af8a208682de8a7d111 and project 0526c12e8bc947209e24daf5ddfad7be. Resources: {'instances', 'cores', 'ram'} {{(pid=117562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 23:04:54.784007 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-fb254711-7bfe-4d66-99d7-17cbf9237e18 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Going to run 1 instances... {{(pid=117562) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 23:04:54.786267 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-fb254711-7bfe-4d66-99d7-17cbf9237e18 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] [instance: 30b2118a-225b-457b-a15d-cf7656c69331] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2b486731-e5ea-4159-b6b1-ed0083e00543',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 23:04:54.830684 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-fb254711-7bfe-4d66-99d7-17cbf9237e18 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.551867 Jun 16 23:04:54.831267 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 294/580] 10.222.0.17 () {60 vars in 1146 bytes} [Thu Jun 16 23:04:54 2022] POST /compute/v2.1/servers => generated 401 bytes in 553 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 16 23:04:54.841928 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-4ac88ab4-38cd-4e9b-8933-5ff2ff14436f tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:04:54.842564 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-4ac88ab4-38cd-4e9b-8933-5ff2ff14436f tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] [instance: 30b2118a-225b-457b-a15d-cf7656c69331] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:04:54.903454 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-4ac88ab4-38cd-4e9b-8933-5ff2ff14436f tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3a2d16133b4af8a208682de8a7d111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0526c12e8bc947209e24daf5ddfad7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:04:54.910261 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-4ac88ab4-38cd-4e9b-8933-5ff2ff14436f tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] 10.222.0.17 "GET /compute/v2.1/servers/30b2118a-225b-457b-a15d-cf7656c69331" status: 200 len: 1241 microversion: 2.1 time: 0.073045 Jun 16 23:04:54.910882 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 287/581] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:04:54 2022] GET /compute/v2.1/servers/30b2118a-225b-457b-a15d-cf7656c69331 => generated 1241 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:04:55.305298 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-9e2d7f92-e092-4ddf-a9be-99b444f234e2 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:04:55.305905 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-9e2d7f92-e092-4ddf-a9be-99b444f234e2 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] [instance: 85395b04-657c-4595-83ca-b6a1635f6daa] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:04:55.312512 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-9e2d7f92-e092-4ddf-a9be-99b444f234e2 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:55.312987 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-9e2d7f92-e092-4ddf-a9be-99b444f234e2 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:55.313746 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-9e2d7f92-e092-4ddf-a9be-99b444f234e2 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:55.314180 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-9e2d7f92-e092-4ddf-a9be-99b444f234e2 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:55.443852 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-9e2d7f92-e092-4ddf-a9be-99b444f234e2 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69163c28aa75492aa01c70532bed15a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9761759a69724a21b0b9315a931b106f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:04:55.451248 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-9e2d7f92-e092-4ddf-a9be-99b444f234e2 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] 10.222.0.17 "GET /compute/v2.1/servers/85395b04-657c-4595-83ca-b6a1635f6daa" status: 200 len: 1515 microversion: 2.1 time: 0.149986 Jun 16 23:04:55.451808 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 295/582] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:04:55 2022] GET /compute/v2.1/servers/85395b04-657c-4595-83ca-b6a1635f6daa => generated 1515 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:04:55.611440 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-d14a419a-819e-49e6-a6dd-12ff93e076f5 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:04:55.612359 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-d14a419a-819e-49e6-a6dd-12ff93e076f5 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 46f43909-d681-4938-8253-5080b626e169] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:04:55.620202 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-d14a419a-819e-49e6-a6dd-12ff93e076f5 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:55.620660 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-d14a419a-819e-49e6-a6dd-12ff93e076f5 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:55.621431 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-d14a419a-819e-49e6-a6dd-12ff93e076f5 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:55.621870 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-d14a419a-819e-49e6-a6dd-12ff93e076f5 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:55.649694 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-d14a419a-819e-49e6-a6dd-12ff93e076f5 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042084 Jun 16 23:04:55.650183 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 288/583] 10.222.0.17 () {60 vars in 1342 bytes} [Thu Jun 16 23:04:55 2022] GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 23:04:55.927072 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-e4fb4a75-824f-487d-a6a6-8c7d66d2e24a tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:04:55.927709 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-e4fb4a75-824f-487d-a6a6-8c7d66d2e24a tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] [instance: 30b2118a-225b-457b-a15d-cf7656c69331] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:04:55.933685 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-e4fb4a75-824f-487d-a6a6-8c7d66d2e24a tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:55.934156 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-e4fb4a75-824f-487d-a6a6-8c7d66d2e24a tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:55.934935 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-e4fb4a75-824f-487d-a6a6-8c7d66d2e24a tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:55.935456 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-e4fb4a75-824f-487d-a6a6-8c7d66d2e24a tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:55.996932 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-e4fb4a75-824f-487d-a6a6-8c7d66d2e24a tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3a2d16133b4af8a208682de8a7d111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0526c12e8bc947209e24daf5ddfad7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:04:56.004288 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-e4fb4a75-824f-487d-a6a6-8c7d66d2e24a tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] 10.222.0.17 "GET /compute/v2.1/servers/30b2118a-225b-457b-a15d-cf7656c69331" status: 200 len: 1293 microversion: 2.1 time: 0.081149 Jun 16 23:04:56.004850 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 296/584] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:04:55 2022] GET /compute/v2.1/servers/30b2118a-225b-457b-a15d-cf7656c69331 => generated 1293 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:04:56.470127 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-0961ea71-95d1-483a-bb0f-054261f00ca7 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:04:56.471094 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-0961ea71-95d1-483a-bb0f-054261f00ca7 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] [instance: 85395b04-657c-4595-83ca-b6a1635f6daa] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:04:56.477913 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-0961ea71-95d1-483a-bb0f-054261f00ca7 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:56.478802 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-0961ea71-95d1-483a-bb0f-054261f00ca7 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:56.479793 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-0961ea71-95d1-483a-bb0f-054261f00ca7 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:56.480396 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-0961ea71-95d1-483a-bb0f-054261f00ca7 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:56.661338 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-4e1c7db3-66bc-4dee-8e16-611c5d54375f tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:04:56.662414 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-4e1c7db3-66bc-4dee-8e16-611c5d54375f tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 46f43909-d681-4938-8253-5080b626e169] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:04:56.670278 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-4e1c7db3-66bc-4dee-8e16-611c5d54375f tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:56.670761 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-4e1c7db3-66bc-4dee-8e16-611c5d54375f tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:56.671546 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-4e1c7db3-66bc-4dee-8e16-611c5d54375f tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:56.671983 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-4e1c7db3-66bc-4dee-8e16-611c5d54375f tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:56.687299 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG dbcounter [-] [117562] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=117562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 23:04:56.706859 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-4e1c7db3-66bc-4dee-8e16-611c5d54375f tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.049372 Jun 16 23:04:56.707441 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 297/585] 10.222.0.17 () {60 vars in 1342 bytes} [Thu Jun 16 23:04:56 2022] GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 23:04:56.783402 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-d30e76c4-07d9-47ba-a847-2f454bac26e8 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:04:56.783909 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-d30e76c4-07d9-47ba-a847-2f454bac26e8 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 46f43909-d681-4938-8253-5080b626e169] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:04:56.790644 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-d30e76c4-07d9-47ba-a847-2f454bac26e8 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:56.791101 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-d30e76c4-07d9-47ba-a847-2f454bac26e8 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:56.791888 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-d30e76c4-07d9-47ba-a847-2f454bac26e8 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:56.792351 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-d30e76c4-07d9-47ba-a847-2f454bac26e8 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:56.821439 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-d30e76c4-07d9-47ba-a847-2f454bac26e8 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 46f43909-d681-4938-8253-5080b626e169] Going to try to terminate instance {{(pid=117562) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 23:04:56.871052 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-0961ea71-95d1-483a-bb0f-054261f00ca7 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69163c28aa75492aa01c70532bed15a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9761759a69724a21b0b9315a931b106f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:04:56.879279 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-0961ea71-95d1-483a-bb0f-054261f00ca7 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] 10.222.0.17 "GET /compute/v2.1/servers/85395b04-657c-4595-83ca-b6a1635f6daa" status: 200 len: 1515 microversion: 2.1 time: 0.413438 Jun 16 23:04:56.880252 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 289/586] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:04:56 2022] GET /compute/v2.1/servers/85395b04-657c-4595-83ca-b6a1635f6daa => generated 1515 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:04:56.915167 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-d30e76c4-07d9-47ba-a847-2f454bac26e8 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "DELETE /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169" status: 204 len: 0 microversion: 2.20 time: 0.135651 Jun 16 23:04:56.916294 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 298/587] 10.222.0.17 () {60 vars in 1279 bytes} [Thu Jun 16 23:04:56 2022] DELETE /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 16 23:04:56.924449 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-45c63df8-34a9-434c-85e8-ecf34df36bde tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:04:56.925444 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-45c63df8-34a9-434c-85e8-ecf34df36bde tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 46f43909-d681-4938-8253-5080b626e169] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:04:56.932162 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-45c63df8-34a9-434c-85e8-ecf34df36bde tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:56.932618 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-45c63df8-34a9-434c-85e8-ecf34df36bde tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:56.933399 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-45c63df8-34a9-434c-85e8-ecf34df36bde tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:56.933842 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-45c63df8-34a9-434c-85e8-ecf34df36bde tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:57.022203 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-e49cdfde-5d15-448e-a981-76a7b41a7af9 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:04:57.024160 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-e49cdfde-5d15-448e-a981-76a7b41a7af9 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] [instance: 30b2118a-225b-457b-a15d-cf7656c69331] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:04:57.029312 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-e49cdfde-5d15-448e-a981-76a7b41a7af9 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:57.029752 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-e49cdfde-5d15-448e-a981-76a7b41a7af9 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:57.030551 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-e49cdfde-5d15-448e-a981-76a7b41a7af9 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:57.031075 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-e49cdfde-5d15-448e-a981-76a7b41a7af9 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:57.126087 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-e49cdfde-5d15-448e-a981-76a7b41a7af9 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3a2d16133b4af8a208682de8a7d111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0526c12e8bc947209e24daf5ddfad7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:04:57.134757 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-e49cdfde-5d15-448e-a981-76a7b41a7af9 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] 10.222.0.17 "GET /compute/v2.1/servers/30b2118a-225b-457b-a15d-cf7656c69331" status: 200 len: 1299 microversion: 2.1 time: 0.117251 Jun 16 23:04:57.135987 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 299/588] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:04:57 2022] GET /compute/v2.1/servers/30b2118a-225b-457b-a15d-cf7656c69331 => generated 1299 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 23:04:57.156644 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-45c63df8-34a9-434c-85e8-ecf34df36bde tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:04:57.166108 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-45c63df8-34a9-434c-85e8-ecf34df36bde tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:04:57.167956 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-45c63df8-34a9-434c-85e8-ecf34df36bde tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:04:57.170204 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-45c63df8-34a9-434c-85e8-ecf34df36bde tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169" status: 200 len: 1723 microversion: 2.20 time: 0.249442 Jun 16 23:04:57.171467 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 290/589] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 23:04:56 2022] GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169 => generated 1723 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 23:04:57.256062 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [req-dd02455d-a458-4654-b15c-598e5f1bac76 req-f2c60233-d029-4eb4-b732-0ba46fa3caef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85395b04-657c-4595-83ca-b6a1635f6daa", "name": "network-vif-deleted", "tag": "ac6a1a50-fbb7-4e39-a93a-0f04a2cdfe38"}]} {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 23:04:57.279883 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [req-dd02455d-a458-4654-b15c-598e5f1bac76 req-f2c60233-d029-4eb4-b732-0ba46fa3caef service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:57.280359 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [req-dd02455d-a458-4654-b15c-598e5f1bac76 req-f2c60233-d029-4eb4-b732-0ba46fa3caef service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:57.292365 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.compute.server_external_events [req-dd02455d-a458-4654-b15c-598e5f1bac76 req-f2c60233-d029-4eb4-b732-0ba46fa3caef service nova] Creating event network-vif-deleted:ac6a1a50-fbb7-4e39-a93a-0f04a2cdfe38 for instance 85395b04-657c-4595-83ca-b6a1635f6daa on hv-cinder-84623 Jun 16 23:04:57.297347 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [req-dd02455d-a458-4654-b15c-598e5f1bac76 req-f2c60233-d029-4eb4-b732-0ba46fa3caef service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044936 Jun 16 23:04:57.297839 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 300/590] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 23:04:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 23:04:57.896632 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-76f8b283-4c76-4c53-9252-d34f770c151a tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:04:57.897241 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-76f8b283-4c76-4c53-9252-d34f770c151a tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] [instance: 85395b04-657c-4595-83ca-b6a1635f6daa] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:04:57.904345 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-76f8b283-4c76-4c53-9252-d34f770c151a tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:57.904799 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-76f8b283-4c76-4c53-9252-d34f770c151a tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:57.905560 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-76f8b283-4c76-4c53-9252-d34f770c151a tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:57.905999 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-76f8b283-4c76-4c53-9252-d34f770c151a tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:57.966869 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-76f8b283-4c76-4c53-9252-d34f770c151a tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69163c28aa75492aa01c70532bed15a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9761759a69724a21b0b9315a931b106f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:04:57.974413 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-76f8b283-4c76-4c53-9252-d34f770c151a tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] 10.222.0.17 "GET /compute/v2.1/servers/85395b04-657c-4595-83ca-b6a1635f6daa" status: 200 len: 1473 microversion: 2.1 time: 0.081570 Jun 16 23:04:57.975021 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 291/591] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:04:57 2022] GET /compute/v2.1/servers/85395b04-657c-4595-83ca-b6a1635f6daa => generated 1473 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:04:58.153175 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-5c1549b1-0f54-4e0e-9dc3-e1bdf880d607 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:04:58.153817 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-5c1549b1-0f54-4e0e-9dc3-e1bdf880d607 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] [instance: 30b2118a-225b-457b-a15d-cf7656c69331] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:04:58.159927 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-5c1549b1-0f54-4e0e-9dc3-e1bdf880d607 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:58.160373 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-5c1549b1-0f54-4e0e-9dc3-e1bdf880d607 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:58.161126 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-5c1549b1-0f54-4e0e-9dc3-e1bdf880d607 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:58.161554 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-5c1549b1-0f54-4e0e-9dc3-e1bdf880d607 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:58.189140 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-a817c7ee-93cd-4008-95c7-4c5db525294f tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:04:58.189750 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-a817c7ee-93cd-4008-95c7-4c5db525294f tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 46f43909-d681-4938-8253-5080b626e169] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:04:58.195854 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-a817c7ee-93cd-4008-95c7-4c5db525294f tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:58.196310 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-a817c7ee-93cd-4008-95c7-4c5db525294f tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:58.197689 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-a817c7ee-93cd-4008-95c7-4c5db525294f tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:58.198132 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-a817c7ee-93cd-4008-95c7-4c5db525294f tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:58.218657 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG dbcounter [-] [117563] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 23:04:58.346240 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-5c1549b1-0f54-4e0e-9dc3-e1bdf880d607 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3a2d16133b4af8a208682de8a7d111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0526c12e8bc947209e24daf5ddfad7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:04:58.356897 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-5c1549b1-0f54-4e0e-9dc3-e1bdf880d607 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] 10.222.0.17 "GET /compute/v2.1/servers/30b2118a-225b-457b-a15d-cf7656c69331" status: 200 len: 1366 microversion: 2.1 time: 0.208225 Jun 16 23:04:58.366126 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 301/592] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:04:58 2022] GET /compute/v2.1/servers/30b2118a-225b-457b-a15d-cf7656c69331 => generated 1366 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:04:58.375582 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-a817c7ee-93cd-4008-95c7-4c5db525294f tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:04:58.383738 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-a817c7ee-93cd-4008-95c7-4c5db525294f tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:04:58.385406 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-a817c7ee-93cd-4008-95c7-4c5db525294f tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:04:58.386577 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-a817c7ee-93cd-4008-95c7-4c5db525294f tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169" status: 200 len: 1723 microversion: 2.20 time: 0.201303 Jun 16 23:04:58.387162 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 292/593] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 23:04:58 2022] GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169 => generated 1723 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 23:04:58.937586 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [req-f54d2099-29b4-4cff-aa33-4c97413a43b5 req-aa9dd209-b6e9-4fc2-8707-d8a2edde6d47 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30b2118a-225b-457b-a15d-cf7656c69331", "tag": "64041190-c0ec-441a-a5bb-be754b053d2d"}]} {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 23:04:58.946975 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [req-f54d2099-29b4-4cff-aa33-4c97413a43b5 req-aa9dd209-b6e9-4fc2-8707-d8a2edde6d47 service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:58.947518 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [req-f54d2099-29b4-4cff-aa33-4c97413a43b5 req-aa9dd209-b6e9-4fc2-8707-d8a2edde6d47 service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:58.967673 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.compute.server_external_events [req-f54d2099-29b4-4cff-aa33-4c97413a43b5 req-aa9dd209-b6e9-4fc2-8707-d8a2edde6d47 service nova] Creating event network-changed:64041190-c0ec-441a-a5bb-be754b053d2d for instance 30b2118a-225b-457b-a15d-cf7656c69331 on hv-cinder-84623 Jun 16 23:04:58.972572 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [req-f54d2099-29b4-4cff-aa33-4c97413a43b5 req-aa9dd209-b6e9-4fc2-8707-d8a2edde6d47 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039406 Jun 16 23:04:58.973616 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 302/594] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 23:04:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 23:04:58.990566 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-c92d7b46-2646-4cdc-b16d-e9b9dcdac270 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:04:58.991306 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-c92d7b46-2646-4cdc-b16d-e9b9dcdac270 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] [instance: 85395b04-657c-4595-83ca-b6a1635f6daa] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:04:58.998666 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-c92d7b46-2646-4cdc-b16d-e9b9dcdac270 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:58.999401 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-c92d7b46-2646-4cdc-b16d-e9b9dcdac270 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:59.000407 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-c92d7b46-2646-4cdc-b16d-e9b9dcdac270 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:59.001037 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-c92d7b46-2646-4cdc-b16d-e9b9dcdac270 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:59.017929 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.wsgi [None req-c92d7b46-2646-4cdc-b16d-e9b9dcdac270 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] HTTP exception thrown: Instance 85395b04-657c-4595-83ca-b6a1635f6daa could not be found. Jun 16 23:04:59.019769 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-c92d7b46-2646-4cdc-b16d-e9b9dcdac270 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Request method failure captured: Jun 16 23:04:59.019769 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: request: GET /compute/v2.1/servers/85395b04-657c-4595-83ca-b6a1635f6daa HTTP/1.1 Jun 16 23:04:59.019769 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Accept: application/json Jun 16 23:04:59.019769 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Accept-Encoding: identity Jun 16 23:04:59.019769 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Connection: close Jun 16 23:04:59.019769 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Content-Length: 0 Jun 16 23:04:59.019769 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Content-Type: application/json Jun 16 23:04:59.019769 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Host: 10.222.0.17 Jun 16 23:04:59.019769 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Openstack-System-Scope: None Jun 16 23:04:59.019769 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: User-Agent: python-urllib3/1.26.9 Jun 16 23:04:59.019769 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Auth-Token: gAAAAABiq7ahjtbRlMoZzrwnXVTID6IyF3UZ9_FACbNOVNGnH_qRHyl7gTANWAFewHIiP7z3aLG9bSxIg9tQ9Yb_gSd_0yTMIP1kQXFb7-CjwZkVGglByREITIbsjaJihqHrGaWodzkGndPHh6sYPFYyHd9362qhfeoQxp37-toGzmsQ8YbBT_o Jun 16 23:04:59.019769 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Domain-Id: None Jun 16 23:04:59.019769 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Domain-Name: None Jun 16 23:04:59.019769 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Identity-Status: Confirmed Jun 16 23:04:59.019769 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Is-Admin-Project: True Jun 16 23:04:59.019769 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Project-Domain-Id: default Jun 16 23:04:59.019769 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Project-Domain-Name: Default Jun 16 23:04:59.019769 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Project-Id: 9761759a69724a21b0b9315a931b106f Jun 16 23:04:59.019769 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1423363191 Jun 16 23:04:59.019769 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Role: member,reader Jun 16 23:04:59.019769 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Roles: member,reader Jun 16 23:04:59.021297 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/9761759a69724a21b0b9315a931b106f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_9761759a69724a21b0b9315a931b106f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9761759a69724a21b0b9315a931b106f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9761759a69724a21b0b9315a931b106f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Jun 16 23:04:59.021297 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Tenant: tempest-VolumesSnapshotTestJSON-1423363191 Jun 16 23:04:59.021297 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Tenant-Id: 9761759a69724a21b0b9315a931b106f Jun 16 23:04:59.021297 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1423363191 Jun 16 23:04:59.021297 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-User: tempest-VolumesSnapshotTestJSON-1423363191-project Jun 16 23:04:59.021297 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-User-Domain-Id: default Jun 16 23:04:59.021297 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-User-Domain-Name: Default Jun 16 23:04:59.021297 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-User-Id: 69163c28aa75492aa01c70532bed15a9 Jun 16 23:04:59.021297 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-User-Name: tempest-VolumesSnapshotTestJSON-1423363191-project Jun 16 23:04:59.021297 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: method: > Jun 16 23:04:59.021297 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: exception: Instance 85395b04-657c-4595-83ca-b6a1635f6daa could not be found. Jun 16 23:04:59.021297 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: action_args: {'id': '85395b04-657c-4595-83ca-b6a1635f6daa'} Jun 16 23:04:59.022216 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 23:04:59.022216 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 23:04:59.022216 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 23:04:59.022216 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 23:04:59.022216 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 23:04:59.022216 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 23:04:59.022216 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 23:04:59.022216 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 23:04:59.022216 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 23:04:59.022216 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 23:04:59.022216 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 85395b04-657c-4595-83ca-b6a1635f6daa could not be found. Jun 16 23:04:59.022216 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 16 23:04:59.022216 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 23:04:59.022216 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 16 23:04:59.022216 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 23:04:59.022216 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 23:04:59.022216 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 23:04:59.022216 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 23:04:59.022216 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 23:04:59.022216 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 23:04:59.023605 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 23:04:59.023605 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 23:04:59.023605 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 23:04:59.023605 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 23:04:59.023605 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 23:04:59.023605 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 23:04:59.023605 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 23:04:59.023605 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85395b04-657c-4595-83ca-b6a1635f6daa could not be found. Jun 16 23:04:59.023605 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 16 23:04:59.023605 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 23:04:59.023605 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 16 23:04:59.023605 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 23:04:59.023605 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 23:04:59.023605 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 23:04:59.023605 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 23:04:59.023605 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 23:04:59.023605 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85395b04-657c-4595-83ca-b6a1635f6daa could not be found. Jun 16 23:04:59.023605 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 16 23:04:59.026952 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-c92d7b46-2646-4cdc-b16d-e9b9dcdac270 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] Returning 404 to user: Instance 85395b04-657c-4595-83ca-b6a1635f6daa could not be found. {{(pid=117563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 23:04:59.028801 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-c92d7b46-2646-4cdc-b16d-e9b9dcdac270 tempest-VolumesSnapshotTestJSON-1423363191 tempest-VolumesSnapshotTestJSON-1423363191-project] 10.222.0.17 "GET /compute/v2.1/servers/85395b04-657c-4595-83ca-b6a1635f6daa" status: 404 len: 111 microversion: 2.1 time: 0.042084 Jun 16 23:04:59.029782 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 293/595] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:04:58 2022] GET /compute/v2.1/servers/85395b04-657c-4595-83ca-b6a1635f6daa => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 23:04:59.376158 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-a7cfbc9e-b403-4c5e-9786-bc25d9a00392 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:04:59.377412 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-a7cfbc9e-b403-4c5e-9786-bc25d9a00392 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] [instance: 30b2118a-225b-457b-a15d-cf7656c69331] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:04:59.385167 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-a7cfbc9e-b403-4c5e-9786-bc25d9a00392 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:59.385621 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-a7cfbc9e-b403-4c5e-9786-bc25d9a00392 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:59.386399 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-a7cfbc9e-b403-4c5e-9786-bc25d9a00392 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:59.387522 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-a7cfbc9e-b403-4c5e-9786-bc25d9a00392 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:59.404674 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-2b2a0b8a-4cf8-4b27-babb-e463dc0bf4cf tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:04:59.405533 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-2b2a0b8a-4cf8-4b27-babb-e463dc0bf4cf tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 46f43909-d681-4938-8253-5080b626e169] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:04:59.414513 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-2b2a0b8a-4cf8-4b27-babb-e463dc0bf4cf tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:59.415511 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-2b2a0b8a-4cf8-4b27-babb-e463dc0bf4cf tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:59.417178 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-2b2a0b8a-4cf8-4b27-babb-e463dc0bf4cf tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:59.419362 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-2b2a0b8a-4cf8-4b27-babb-e463dc0bf4cf tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:59.719629 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-a7cfbc9e-b403-4c5e-9786-bc25d9a00392 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3a2d16133b4af8a208682de8a7d111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0526c12e8bc947209e24daf5ddfad7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:04:59.727121 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-a7cfbc9e-b403-4c5e-9786-bc25d9a00392 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] 10.222.0.17 "GET /compute/v2.1/servers/30b2118a-225b-457b-a15d-cf7656c69331" status: 200 len: 1366 microversion: 2.1 time: 0.357480 Jun 16 23:04:59.727714 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 303/596] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:04:59 2022] GET /compute/v2.1/servers/30b2118a-225b-457b-a15d-cf7656c69331 => generated 1366 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:04:59.729285 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-2b2a0b8a-4cf8-4b27-babb-e463dc0bf4cf tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:04:59.737351 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-2b2a0b8a-4cf8-4b27-babb-e463dc0bf4cf tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:04:59.738887 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-2b2a0b8a-4cf8-4b27-babb-e463dc0bf4cf tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:04:59.740040 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-2b2a0b8a-4cf8-4b27-babb-e463dc0bf4cf tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169" status: 200 len: 1723 microversion: 2.20 time: 0.339684 Jun 16 23:04:59.740639 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 294/597] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 23:04:59 2022] GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169 => generated 1723 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 23:04:59.947923 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [req-1dab965e-441b-4589-b6a8-2df2d9518cab req-81040b5c-6cf0-4267-8aca-f5fac8b354e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46f43909-d681-4938-8253-5080b626e169", "name": "network-vif-deleted", "tag": "42e82895-598b-468f-aac2-e51ebe9d9946"}]} {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 23:04:59.956280 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [req-1dab965e-441b-4589-b6a8-2df2d9518cab req-81040b5c-6cf0-4267-8aca-f5fac8b354e0 service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:04:59.956725 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [req-1dab965e-441b-4589-b6a8-2df2d9518cab req-81040b5c-6cf0-4267-8aca-f5fac8b354e0 service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:04:59.968533 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.compute.server_external_events [req-1dab965e-441b-4589-b6a8-2df2d9518cab req-81040b5c-6cf0-4267-8aca-f5fac8b354e0 service nova] Creating event network-vif-deleted:42e82895-598b-468f-aac2-e51ebe9d9946 for instance 46f43909-d681-4938-8253-5080b626e169 on hv-cinder-84623 Jun 16 23:04:59.973714 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [req-1dab965e-441b-4589-b6a8-2df2d9518cab req-81040b5c-6cf0-4267-8aca-f5fac8b354e0 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029311 Jun 16 23:04:59.974319 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 304/598] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 23:04:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 23:05:00.743942 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-a6910ebf-c6c6-4df8-a64c-3551eee67e68 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:05:00.744818 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-a6910ebf-c6c6-4df8-a64c-3551eee67e68 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] [instance: 30b2118a-225b-457b-a15d-cf7656c69331] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:05:00.751571 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-a6910ebf-c6c6-4df8-a64c-3551eee67e68 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:00.752016 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-a6910ebf-c6c6-4df8-a64c-3551eee67e68 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:00.753111 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-a6910ebf-c6c6-4df8-a64c-3551eee67e68 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:00.753729 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-a6910ebf-c6c6-4df8-a64c-3551eee67e68 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:00.758127 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-f5f9551f-cc54-4dae-b7bb-c1f3b87ead25 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:05:00.759353 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-f5f9551f-cc54-4dae-b7bb-c1f3b87ead25 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 46f43909-d681-4938-8253-5080b626e169] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:05:00.765967 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-f5f9551f-cc54-4dae-b7bb-c1f3b87ead25 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:00.766448 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-f5f9551f-cc54-4dae-b7bb-c1f3b87ead25 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:00.767245 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-f5f9551f-cc54-4dae-b7bb-c1f3b87ead25 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:00.767679 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-f5f9551f-cc54-4dae-b7bb-c1f3b87ead25 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:00.802054 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-f5f9551f-cc54-4dae-b7bb-c1f3b87ead25 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:00.802509 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-f5f9551f-cc54-4dae-b7bb-c1f3b87ead25 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:00.802994 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.objects.instance [None req-f5f9551f-cc54-4dae-b7bb-c1f3b87ead25 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lazy-loading 'fault' on Instance uuid 46f43909-d681-4938-8253-5080b626e169 {{(pid=117562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 23:05:00.850430 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-f5f9551f-cc54-4dae-b7bb-c1f3b87ead25 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:05:00.859206 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-f5f9551f-cc54-4dae-b7bb-c1f3b87ead25 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:05:00.861007 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-f5f9551f-cc54-4dae-b7bb-c1f3b87ead25 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:05:00.862171 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-f5f9551f-cc54-4dae-b7bb-c1f3b87ead25 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169" status: 200 len: 1372 microversion: 2.20 time: 0.108211 Jun 16 23:05:00.862748 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 305/599] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 23:05:00 2022] GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169 => generated 1372 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 23:05:00.956334 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-a6910ebf-c6c6-4df8-a64c-3551eee67e68 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3a2d16133b4af8a208682de8a7d111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0526c12e8bc947209e24daf5ddfad7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:05:00.964764 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-a6910ebf-c6c6-4df8-a64c-3551eee67e68 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] 10.222.0.17 "GET /compute/v2.1/servers/30b2118a-225b-457b-a15d-cf7656c69331" status: 200 len: 1366 microversion: 2.1 time: 0.224753 Jun 16 23:05:00.965326 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 295/600] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:05:00 2022] GET /compute/v2.1/servers/30b2118a-225b-457b-a15d-cf7656c69331 => generated 1366 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:05:01.879760 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-3fd03a33-884e-4452-ae9f-f9a24ed87a34 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:05:01.880360 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-3fd03a33-884e-4452-ae9f-f9a24ed87a34 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 46f43909-d681-4938-8253-5080b626e169] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:05:01.886896 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-3fd03a33-884e-4452-ae9f-f9a24ed87a34 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:01.887286 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-3fd03a33-884e-4452-ae9f-f9a24ed87a34 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:01.888047 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-3fd03a33-884e-4452-ae9f-f9a24ed87a34 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:01.888477 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-3fd03a33-884e-4452-ae9f-f9a24ed87a34 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:01.918347 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-3fd03a33-884e-4452-ae9f-f9a24ed87a34 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:01.918855 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-3fd03a33-884e-4452-ae9f-f9a24ed87a34 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:01.919297 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.objects.instance [None req-3fd03a33-884e-4452-ae9f-f9a24ed87a34 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lazy-loading 'fault' on Instance uuid 46f43909-d681-4938-8253-5080b626e169 {{(pid=117562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 23:05:01.958073 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-3fd03a33-884e-4452-ae9f-f9a24ed87a34 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:05:01.966546 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-3fd03a33-884e-4452-ae9f-f9a24ed87a34 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:05:01.968067 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-3fd03a33-884e-4452-ae9f-f9a24ed87a34 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:05:01.969236 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-3fd03a33-884e-4452-ae9f-f9a24ed87a34 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169" status: 200 len: 1372 microversion: 2.20 time: 0.093334 Jun 16 23:05:01.969790 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 306/601] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 23:05:01 2022] GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169 => generated 1372 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 23:05:01.981763 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-ae724f67-f9de-4071-9c2c-6111e4dcac64 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:05:01.982374 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-ae724f67-f9de-4071-9c2c-6111e4dcac64 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] [instance: 30b2118a-225b-457b-a15d-cf7656c69331] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:05:01.988855 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-ae724f67-f9de-4071-9c2c-6111e4dcac64 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:01.989311 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-ae724f67-f9de-4071-9c2c-6111e4dcac64 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:01.990074 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-ae724f67-f9de-4071-9c2c-6111e4dcac64 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:01.990514 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-ae724f67-f9de-4071-9c2c-6111e4dcac64 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:02.118210 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-ae724f67-f9de-4071-9c2c-6111e4dcac64 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3a2d16133b4af8a208682de8a7d111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0526c12e8bc947209e24daf5ddfad7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:05:02.125501 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-ae724f67-f9de-4071-9c2c-6111e4dcac64 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] 10.222.0.17 "GET /compute/v2.1/servers/30b2118a-225b-457b-a15d-cf7656c69331" status: 200 len: 1366 microversion: 2.1 time: 0.148218 Jun 16 23:05:02.126057 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 296/602] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:05:01 2022] GET /compute/v2.1/servers/30b2118a-225b-457b-a15d-cf7656c69331 => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:05:02.988532 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-2ca0bc9a-6205-4b86-bbe3-671f938245e9 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:05:02.989039 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-2ca0bc9a-6205-4b86-bbe3-671f938245e9 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 46f43909-d681-4938-8253-5080b626e169] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:05:02.996334 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-2ca0bc9a-6205-4b86-bbe3-671f938245e9 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:02.997310 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-2ca0bc9a-6205-4b86-bbe3-671f938245e9 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:02.997740 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-2ca0bc9a-6205-4b86-bbe3-671f938245e9 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:02.998172 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-2ca0bc9a-6205-4b86-bbe3-671f938245e9 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:03.032421 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-2ca0bc9a-6205-4b86-bbe3-671f938245e9 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:03.032865 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-2ca0bc9a-6205-4b86-bbe3-671f938245e9 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:03.033312 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.objects.instance [None req-2ca0bc9a-6205-4b86-bbe3-671f938245e9 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lazy-loading 'fault' on Instance uuid 46f43909-d681-4938-8253-5080b626e169 {{(pid=117562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 23:05:03.073267 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-2ca0bc9a-6205-4b86-bbe3-671f938245e9 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:05:03.080999 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-2ca0bc9a-6205-4b86-bbe3-671f938245e9 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:05:03.082484 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-2ca0bc9a-6205-4b86-bbe3-671f938245e9 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:05:03.083643 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-2ca0bc9a-6205-4b86-bbe3-671f938245e9 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169" status: 200 len: 1372 microversion: 2.20 time: 0.099705 Jun 16 23:05:03.084188 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 307/603] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 23:05:02 2022] GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169 => generated 1372 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 23:05:03.142431 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-4d9c413b-10ff-4e97-a36a-cf47952e6d75 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:05:03.143061 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-4d9c413b-10ff-4e97-a36a-cf47952e6d75 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] [instance: 30b2118a-225b-457b-a15d-cf7656c69331] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:05:03.150039 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-4d9c413b-10ff-4e97-a36a-cf47952e6d75 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:03.150488 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-4d9c413b-10ff-4e97-a36a-cf47952e6d75 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:03.151284 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-4d9c413b-10ff-4e97-a36a-cf47952e6d75 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:03.151722 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-4d9c413b-10ff-4e97-a36a-cf47952e6d75 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:03.280361 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-4d9c413b-10ff-4e97-a36a-cf47952e6d75 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3a2d16133b4af8a208682de8a7d111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0526c12e8bc947209e24daf5ddfad7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:05:03.287641 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-4d9c413b-10ff-4e97-a36a-cf47952e6d75 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] 10.222.0.17 "GET /compute/v2.1/servers/30b2118a-225b-457b-a15d-cf7656c69331" status: 200 len: 1366 microversion: 2.1 time: 0.149054 Jun 16 23:05:03.288367 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 297/604] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:05:03 2022] GET /compute/v2.1/servers/30b2118a-225b-457b-a15d-cf7656c69331 => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:05:04.101741 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-e6750e34-bceb-40f7-9eaa-c34d0edc60df tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:05:04.103045 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-e6750e34-bceb-40f7-9eaa-c34d0edc60df tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 46f43909-d681-4938-8253-5080b626e169] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:05:04.109161 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-e6750e34-bceb-40f7-9eaa-c34d0edc60df tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:04.109609 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-e6750e34-bceb-40f7-9eaa-c34d0edc60df tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:04.110362 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-e6750e34-bceb-40f7-9eaa-c34d0edc60df tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:04.110827 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-e6750e34-bceb-40f7-9eaa-c34d0edc60df tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:04.124004 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.wsgi [None req-e6750e34-bceb-40f7-9eaa-c34d0edc60df tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] HTTP exception thrown: Instance 46f43909-d681-4938-8253-5080b626e169 could not be found. Jun 16 23:05:04.125612 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-e6750e34-bceb-40f7-9eaa-c34d0edc60df tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Request method failure captured: Jun 16 23:05:04.125612 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: request: GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169 HTTP/1.1 Jun 16 23:05:04.125612 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Accept: application/json Jun 16 23:05:04.125612 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Accept-Encoding: identity Jun 16 23:05:04.125612 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Connection: close Jun 16 23:05:04.125612 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Content-Length: 0 Jun 16 23:05:04.125612 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Content-Type: application/json Jun 16 23:05:04.125612 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Host: 10.222.0.17 Jun 16 23:05:04.125612 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Openstack-System-Scope: None Jun 16 23:05:04.125612 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: User-Agent: python-urllib3/1.26.9 Jun 16 23:05:04.125612 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Auth-Token: gAAAAABiq7YkgiffNcWtxIe1f-Ym0r_NFffERJq1DAa6U7CivInFe3qIgAFqxI9XpTHPB4nvxD_hmw4DL7Hkzl06iEFyRPrqAmh_eIIzJ0mr-rBV0EZooAA5T9EpRJ9h0qd9xe0xEBWxM8y8kHq-41mybPXG0kgmM3CmX8N5E-dMI_xz415q7Zg Jun 16 23:05:04.125612 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Domain-Id: None Jun 16 23:05:04.125612 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Domain-Name: None Jun 16 23:05:04.125612 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Identity-Status: Confirmed Jun 16 23:05:04.125612 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Is-Admin-Project: True Jun 16 23:05:04.125612 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Openstack-Nova-Api-Version: 2.20 Jun 16 23:05:04.125612 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Project-Domain-Id: default Jun 16 23:05:04.125612 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Project-Domain-Name: Default Jun 16 23:05:04.125612 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Project-Id: 6fc0acf708204e1f8f4510cdb1bbf442 Jun 16 23:05:04.125612 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2045494089 Jun 16 23:05:04.125612 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Role: member,reader Jun 16 23:05:04.125612 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Roles: member,reader Jun 16 23:05:04.127204 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6fc0acf708204e1f8f4510cdb1bbf442"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6fc0acf708204e1f8f4510cdb1bbf442"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6fc0acf708204e1f8f4510cdb1bbf442"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6fc0acf708204e1f8f4510cdb1bbf442"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Jun 16 23:05:04.127204 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2045494089 Jun 16 23:05:04.127204 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Tenant-Id: 6fc0acf708204e1f8f4510cdb1bbf442 Jun 16 23:05:04.127204 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2045494089 Jun 16 23:05:04.127204 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-User: tempest-AttachVolumeShelveTestJSON-2045494089-project Jun 16 23:05:04.127204 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-User-Domain-Id: default Jun 16 23:05:04.127204 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-User-Domain-Name: Default Jun 16 23:05:04.127204 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-User-Id: a1b1a557a3834b98a3397c41665b5dc6 Jun 16 23:05:04.127204 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2045494089-project Jun 16 23:05:04.127204 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: method: > Jun 16 23:05:04.127204 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: exception: Instance 46f43909-d681-4938-8253-5080b626e169 could not be found. Jun 16 23:05:04.127204 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: action_args: {'id': '46f43909-d681-4938-8253-5080b626e169'} Jun 16 23:05:04.128085 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 23:05:04.128085 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 23:05:04.128085 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 23:05:04.128085 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 23:05:04.128085 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 23:05:04.128085 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 23:05:04.128085 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 23:05:04.128085 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 23:05:04.128085 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 23:05:04.128085 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 23:05:04.128085 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46f43909-d681-4938-8253-5080b626e169 could not be found. Jun 16 23:05:04.128085 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Jun 16 23:05:04.128085 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 23:05:04.128085 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Jun 16 23:05:04.128085 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 23:05:04.128085 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 23:05:04.128085 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 23:05:04.128085 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 23:05:04.128085 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 23:05:04.128085 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 23:05:04.129458 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 23:05:04.129458 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 23:05:04.129458 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 23:05:04.129458 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 23:05:04.129458 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 23:05:04.129458 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 23:05:04.129458 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 23:05:04.129458 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46f43909-d681-4938-8253-5080b626e169 could not be found. Jun 16 23:05:04.129458 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Jun 16 23:05:04.129458 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 23:05:04.129458 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Jun 16 23:05:04.129458 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 23:05:04.129458 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 23:05:04.129458 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 23:05:04.129458 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 23:05:04.129458 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 23:05:04.129458 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46f43909-d681-4938-8253-5080b626e169 could not be found. Jun 16 23:05:04.129458 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Jun 16 23:05:04.130701 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-e6750e34-bceb-40f7-9eaa-c34d0edc60df tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Returning 404 to user: Instance 46f43909-d681-4938-8253-5080b626e169 could not be found. {{(pid=117562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 23:05:04.130701 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-e6750e34-bceb-40f7-9eaa-c34d0edc60df tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169" status: 404 len: 111 microversion: 2.20 time: 0.029423 Jun 16 23:05:04.130701 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 308/605] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 23:05:04 2022] GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 16 23:05:04.135969 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-b771be5a-5559-4d6f-99c8-00ae23bf92a2 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Calling method '.version_select at 0x7f531362b310>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:05:04.152932 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-b771be5a-5559-4d6f-99c8-00ae23bf92a2 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2141003716" status: 204 len: 0 microversion: 2.20 time: 0.020881 Jun 16 23:05:04.153504 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 298/606] 10.222.0.17 () {60 vars in 1261 bytes} [Thu Jun 16 23:05:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2141003716 => generated 0 bytes in 22 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 16 23:05:04.305617 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-57e3170c-99a3-4e76-a254-f597e6836479 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:05:04.306433 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-57e3170c-99a3-4e76-a254-f597e6836479 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] [instance: 30b2118a-225b-457b-a15d-cf7656c69331] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:05:04.323692 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-57e3170c-99a3-4e76-a254-f597e6836479 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:04.324331 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-57e3170c-99a3-4e76-a254-f597e6836479 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:04.325142 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-57e3170c-99a3-4e76-a254-f597e6836479 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:04.325580 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-57e3170c-99a3-4e76-a254-f597e6836479 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:04.464873 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-57e3170c-99a3-4e76-a254-f597e6836479 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3a2d16133b4af8a208682de8a7d111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0526c12e8bc947209e24daf5ddfad7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:05:04.472962 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-57e3170c-99a3-4e76-a254-f597e6836479 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] 10.222.0.17 "GET /compute/v2.1/servers/30b2118a-225b-457b-a15d-cf7656c69331" status: 200 len: 1366 microversion: 2.1 time: 0.171718 Jun 16 23:05:04.473560 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 309/607] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:05:04 2022] GET /compute/v2.1/servers/30b2118a-225b-457b-a15d-cf7656c69331 => generated 1366 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:05:04.799744 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-1524f03a-25d9-41f2-8f80-0695673effae tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Action: 'create', calling method: .version_select at 0x7f5313734040>, body: {"keypair": {"name": "tempest-keypair-1662971911", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJXGm6H1/R8iwQQdeeFPIzlRfdyrKr2bWHw0o6ae46pg62tvqfGPRXSZW4cjL7CjQWN+XX2vOQmowwQqrDoTdd352aWtGEuXLhOoV4yBYid+YfwF+n6s8e8dNbBVMo7D4Q=="}} {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 23:05:04.814321 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.quota [None req-1524f03a-25d9-41f2-8f80-0695673effae tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Getting quotas for project 6fc0acf708204e1f8f4510cdb1bbf442. Resources: {'key_pairs'} {{(pid=117563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 23:05:04.818326 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.quota [None req-1524f03a-25d9-41f2-8f80-0695673effae tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Getting quotas for user a1b1a557a3834b98a3397c41665b5dc6 and project 6fc0acf708204e1f8f4510cdb1bbf442. Resources: {'key_pairs'} {{(pid=117563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 23:05:04.841965 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-1524f03a-25d9-41f2-8f80-0695673effae tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.046084 Jun 16 23:05:04.842913 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 299/608] 10.222.0.17 () {62 vars in 1199 bytes} [Thu Jun 16 23:05:04 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 48 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 16 23:05:05.489402 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-391ce725-7700-4e26-925a-8f8dcba9573c tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:05:05.490656 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-391ce725-7700-4e26-925a-8f8dcba9573c tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] [instance: 30b2118a-225b-457b-a15d-cf7656c69331] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:05:05.493341 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG dbcounter [-] [117562] Writing DB stats nova_cell0:SELECT=2 {{(pid=117562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 23:05:05.494171 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG dbcounter [-] [117562] Writing DB stats nova_cell0:SELECT=10 {{(pid=117562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 23:05:05.500573 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-391ce725-7700-4e26-925a-8f8dcba9573c tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:05.501017 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-391ce725-7700-4e26-925a-8f8dcba9573c tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:05.501786 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-391ce725-7700-4e26-925a-8f8dcba9573c tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:05.502392 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-391ce725-7700-4e26-925a-8f8dcba9573c tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:05.665707 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-391ce725-7700-4e26-925a-8f8dcba9573c tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3a2d16133b4af8a208682de8a7d111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0526c12e8bc947209e24daf5ddfad7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:05:05.676910 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-391ce725-7700-4e26-925a-8f8dcba9573c tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] 10.222.0.17 "GET /compute/v2.1/servers/30b2118a-225b-457b-a15d-cf7656c69331" status: 200 len: 1366 microversion: 2.1 time: 0.191458 Jun 16 23:05:05.677589 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 310/609] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:05:05 2022] GET /compute/v2.1/servers/30b2118a-225b-457b-a15d-cf7656c69331 => generated 1366 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:05:06.129133 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-14ad69b5-e0dd-4ad6-baad-51f6f6464728 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-380519603", "imageRef": "2b486731-e5ea-4159-b6b1-ed0083e00543", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f202f4d7-e0e3-4d9b-8b91-98aa75fbf7a3"}], "security_groups": [{"name": "tempest-securitygroup--1776726280"}], "key_name": "tempest-keypair-1662971911", "user_data": "}} {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 23:05:06.225484 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.network.neutron [None req-14ad69b5-e0dd-4ad6-baad-51f6f6464728 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] validate_networks() for [('f202f4d7-e0e3-4d9b-8b91-98aa75fbf7a3', None, None, None, None, None)] {{(pid=117563) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 23:05:06.607633 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.virt.hardware [None req-14ad69b5-e0dd-4ad6-baad-51f6f6464728 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Flavor limits 0:0:0 {{(pid=117563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 23:05:06.608050 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.virt.hardware [None req-14ad69b5-e0dd-4ad6-baad-51f6f6464728 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Image limits 0:0:0 {{(pid=117563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 23:05:06.608520 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.virt.hardware [None req-14ad69b5-e0dd-4ad6-baad-51f6f6464728 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Flavor pref 0:0:0 {{(pid=117563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 23:05:06.608922 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.virt.hardware [None req-14ad69b5-e0dd-4ad6-baad-51f6f6464728 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Image pref 0:0:0 {{(pid=117563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 23:05:06.609354 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.virt.hardware [None req-14ad69b5-e0dd-4ad6-baad-51f6f6464728 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 23:05:06.617958 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-14ad69b5-e0dd-4ad6-baad-51f6f6464728 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:06.618398 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-14ad69b5-e0dd-4ad6-baad-51f6f6464728 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:06.619232 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-14ad69b5-e0dd-4ad6-baad-51f6f6464728 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:06.619665 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-14ad69b5-e0dd-4ad6-baad-51f6f6464728 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:06.635922 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.quota [None req-14ad69b5-e0dd-4ad6-baad-51f6f6464728 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Getting quotas for project 6fc0acf708204e1f8f4510cdb1bbf442. Resources: {'instances', 'cores', 'ram'} {{(pid=117563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 23:05:06.639756 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.quota [None req-14ad69b5-e0dd-4ad6-baad-51f6f6464728 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Getting quotas for user a1b1a557a3834b98a3397c41665b5dc6 and project 6fc0acf708204e1f8f4510cdb1bbf442. Resources: {'instances', 'cores', 'ram'} {{(pid=117563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 23:05:06.651203 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-14ad69b5-e0dd-4ad6-baad-51f6f6464728 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Going to run 1 instances... {{(pid=117563) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 23:05:06.653410 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-14ad69b5-e0dd-4ad6-baad-51f6f6464728 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2b486731-e5ea-4159-b6b1-ed0083e00543',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117563) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 23:05:06.694360 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-7fae651f-2b00-4c49-b68d-ccdb2183b82e tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:05:06.695026 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-7fae651f-2b00-4c49-b68d-ccdb2183b82e tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] [instance: 30b2118a-225b-457b-a15d-cf7656c69331] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:05:06.700021 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-14ad69b5-e0dd-4ad6-baad-51f6f6464728 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.575525 Jun 16 23:05:06.702322 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-7fae651f-2b00-4c49-b68d-ccdb2183b82e tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:06.702648 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 300/610] 10.222.0.17 () {62 vars in 1187 bytes} [Thu Jun 16 23:05:06 2022] POST /compute/v2.1/servers => generated 402 bytes in 577 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 16 23:05:06.702818 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-7fae651f-2b00-4c49-b68d-ccdb2183b82e tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:06.703597 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-7fae651f-2b00-4c49-b68d-ccdb2183b82e tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:06.704043 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-7fae651f-2b00-4c49-b68d-ccdb2183b82e tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:06.712895 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-4c13f289-8571-41c1-b30b-1ee099d64cc1 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:05:06.713506 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-4c13f289-8571-41c1-b30b-1ee099d64cc1 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:05:06.776524 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-4c13f289-8571-41c1-b30b-1ee099d64cc1 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:05:06.788001 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-4c13f289-8571-41c1-b30b-1ee099d64cc1 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:05:06.790206 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-4c13f289-8571-41c1-b30b-1ee099d64cc1 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:05:06.791368 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-4c13f289-8571-41c1-b30b-1ee099d64cc1 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "GET /compute/v2.1/servers/88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda" status: 200 len: 1281 microversion: 2.20 time: 0.083238 Jun 16 23:05:06.792153 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 301/611] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 23:05:06 2022] GET /compute/v2.1/servers/88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda => generated 1281 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 23:05:06.879437 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-7fae651f-2b00-4c49-b68d-ccdb2183b82e tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3a2d16133b4af8a208682de8a7d111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0526c12e8bc947209e24daf5ddfad7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:05:06.889765 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-7fae651f-2b00-4c49-b68d-ccdb2183b82e tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] 10.222.0.17 "GET /compute/v2.1/servers/30b2118a-225b-457b-a15d-cf7656c69331" status: 200 len: 1366 microversion: 2.1 time: 0.199093 Jun 16 23:05:06.890340 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 311/612] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:05:06 2022] GET /compute/v2.1/servers/30b2118a-225b-457b-a15d-cf7656c69331 => generated 1366 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 23:05:07.622004 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [req-121270fe-00af-492c-b2ac-eda833f934f9 req-ffb273b6-77af-43d6-8f3b-a04a7253c4ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30b2118a-225b-457b-a15d-cf7656c69331", "name": "network-vif-plugged", "status": "completed", "tag": "64041190-c0ec-441a-a5bb-be754b053d2d"}]} {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 23:05:07.630334 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-121270fe-00af-492c-b2ac-eda833f934f9 req-ffb273b6-77af-43d6-8f3b-a04a7253c4ba service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:07.631066 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-121270fe-00af-492c-b2ac-eda833f934f9 req-ffb273b6-77af-43d6-8f3b-a04a7253c4ba service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:07.655085 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.compute.server_external_events [req-121270fe-00af-492c-b2ac-eda833f934f9 req-ffb273b6-77af-43d6-8f3b-a04a7253c4ba service nova] Creating event network-vif-plugged:64041190-c0ec-441a-a5bb-be754b053d2d for instance 30b2118a-225b-457b-a15d-cf7656c69331 on hv-cinder-84623 Jun 16 23:05:07.661727 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [req-121270fe-00af-492c-b2ac-eda833f934f9 req-ffb273b6-77af-43d6-8f3b-a04a7253c4ba service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043510 Jun 16 23:05:07.662846 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 302/613] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 23:05:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 23:05:07.811780 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-55bcc478-e2a3-4ba6-a879-095492dc44c0 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:05:07.812741 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-55bcc478-e2a3-4ba6-a879-095492dc44c0 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:05:07.820297 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-55bcc478-e2a3-4ba6-a879-095492dc44c0 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:07.821712 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-55bcc478-e2a3-4ba6-a879-095492dc44c0 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:07.822937 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-55bcc478-e2a3-4ba6-a879-095492dc44c0 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:07.823479 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-55bcc478-e2a3-4ba6-a879-095492dc44c0 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:07.908439 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-5b7b43ca-c086-4ce1-b31b-470cab7f24ff tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:05:07.909144 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-5b7b43ca-c086-4ce1-b31b-470cab7f24ff tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] [instance: 30b2118a-225b-457b-a15d-cf7656c69331] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:05:07.911755 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-55bcc478-e2a3-4ba6-a879-095492dc44c0 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:05:07.921751 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-55bcc478-e2a3-4ba6-a879-095492dc44c0 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:05:07.923333 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-55bcc478-e2a3-4ba6-a879-095492dc44c0 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:05:07.924382 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-5b7b43ca-c086-4ce1-b31b-470cab7f24ff tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:07.924517 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-55bcc478-e2a3-4ba6-a879-095492dc44c0 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "GET /compute/v2.1/servers/88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda" status: 200 len: 1351 microversion: 2.20 time: 0.118178 Jun 16 23:05:07.925124 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-5b7b43ca-c086-4ce1-b31b-470cab7f24ff tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:07.925244 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 312/614] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 23:05:07 2022] GET /compute/v2.1/servers/88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda => generated 1351 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 23:05:07.926149 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-5b7b43ca-c086-4ce1-b31b-470cab7f24ff tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:07.926627 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-5b7b43ca-c086-4ce1-b31b-470cab7f24ff tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:08.097906 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-5b7b43ca-c086-4ce1-b31b-470cab7f24ff tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3a2d16133b4af8a208682de8a7d111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0526c12e8bc947209e24daf5ddfad7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:05:08.105904 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-5b7b43ca-c086-4ce1-b31b-470cab7f24ff tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] 10.222.0.17 "GET /compute/v2.1/servers/30b2118a-225b-457b-a15d-cf7656c69331" status: 200 len: 1366 microversion: 2.1 time: 0.201495 Jun 16 23:05:08.106511 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 303/615] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:05:07 2022] GET /compute/v2.1/servers/30b2118a-225b-457b-a15d-cf7656c69331 => generated 1366 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 23:05:08.943116 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-15e8106d-c0e6-4200-b36a-b5210804b125 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:05:08.943655 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-15e8106d-c0e6-4200-b36a-b5210804b125 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:05:08.950678 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-15e8106d-c0e6-4200-b36a-b5210804b125 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:08.951134 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-15e8106d-c0e6-4200-b36a-b5210804b125 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:08.951897 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-15e8106d-c0e6-4200-b36a-b5210804b125 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:08.952338 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-15e8106d-c0e6-4200-b36a-b5210804b125 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:09.123070 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-48193a5e-e07e-4990-973e-571c1af03aaa tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:05:09.123686 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-48193a5e-e07e-4990-973e-571c1af03aaa tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] [instance: 30b2118a-225b-457b-a15d-cf7656c69331] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:05:09.130581 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-48193a5e-e07e-4990-973e-571c1af03aaa tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:09.131059 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-48193a5e-e07e-4990-973e-571c1af03aaa tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:09.131847 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-48193a5e-e07e-4990-973e-571c1af03aaa tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:09.132286 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-48193a5e-e07e-4990-973e-571c1af03aaa tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:09.361021 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-15e8106d-c0e6-4200-b36a-b5210804b125 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:05:09.369292 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-15e8106d-c0e6-4200-b36a-b5210804b125 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:05:09.371464 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-15e8106d-c0e6-4200-b36a-b5210804b125 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:05:09.372966 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-15e8106d-c0e6-4200-b36a-b5210804b125 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "GET /compute/v2.1/servers/88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda" status: 200 len: 1407 microversion: 2.20 time: 0.433815 Jun 16 23:05:09.373539 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 313/616] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 23:05:08 2022] GET /compute/v2.1/servers/88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda => generated 1407 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 23:05:09.405729 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-48193a5e-e07e-4990-973e-571c1af03aaa tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3a2d16133b4af8a208682de8a7d111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0526c12e8bc947209e24daf5ddfad7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:05:09.413030 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-48193a5e-e07e-4990-973e-571c1af03aaa tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] 10.222.0.17 "GET /compute/v2.1/servers/30b2118a-225b-457b-a15d-cf7656c69331" status: 200 len: 1366 microversion: 2.1 time: 0.293876 Jun 16 23:05:09.413586 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 304/617] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:05:09 2022] GET /compute/v2.1/servers/30b2118a-225b-457b-a15d-cf7656c69331 => generated 1366 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 23:05:10.393562 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-63c75ed0-ec84-461d-8549-74d4fa830465 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:05:10.394168 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-63c75ed0-ec84-461d-8549-74d4fa830465 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:05:10.400753 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-63c75ed0-ec84-461d-8549-74d4fa830465 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:10.401204 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-63c75ed0-ec84-461d-8549-74d4fa830465 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:10.401976 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-63c75ed0-ec84-461d-8549-74d4fa830465 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:10.402419 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-63c75ed0-ec84-461d-8549-74d4fa830465 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:10.406277 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG dbcounter [-] [117562] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 23:05:10.430506 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-3eeb36d3-d93a-4840-9471-29d76bc3418c tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:05:10.431274 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-3eeb36d3-d93a-4840-9471-29d76bc3418c tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] [instance: 30b2118a-225b-457b-a15d-cf7656c69331] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:05:10.437764 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-3eeb36d3-d93a-4840-9471-29d76bc3418c tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:10.438287 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-3eeb36d3-d93a-4840-9471-29d76bc3418c tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:10.439154 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-3eeb36d3-d93a-4840-9471-29d76bc3418c tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:10.439685 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-3eeb36d3-d93a-4840-9471-29d76bc3418c tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:10.585545 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-63c75ed0-ec84-461d-8549-74d4fa830465 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:05:10.593815 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-63c75ed0-ec84-461d-8549-74d4fa830465 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:05:10.595365 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-63c75ed0-ec84-461d-8549-74d4fa830465 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:05:10.596476 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-63c75ed0-ec84-461d-8549-74d4fa830465 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "GET /compute/v2.1/servers/88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda" status: 200 len: 1407 microversion: 2.20 time: 0.206897 Jun 16 23:05:10.597040 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 314/618] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 23:05:10 2022] GET /compute/v2.1/servers/88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda => generated 1407 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 23:05:10.606328 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-3eeb36d3-d93a-4840-9471-29d76bc3418c tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3a2d16133b4af8a208682de8a7d111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0526c12e8bc947209e24daf5ddfad7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:05:10.613702 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-3eeb36d3-d93a-4840-9471-29d76bc3418c tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] 10.222.0.17 "GET /compute/v2.1/servers/30b2118a-225b-457b-a15d-cf7656c69331" status: 200 len: 1366 microversion: 2.1 time: 0.187653 Jun 16 23:05:10.614249 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 305/619] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:05:10 2022] GET /compute/v2.1/servers/30b2118a-225b-457b-a15d-cf7656c69331 => generated 1366 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:05:11.284564 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [req-f3f650ef-79d7-4343-b047-df133d2dbd98 req-b0ce1022-8c8c-4b38-acf0-0d21e7f8c70b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda", "tag": "4b3b90f0-95df-4c59-9186-169416370496"}]} {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 23:05:11.293813 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [req-f3f650ef-79d7-4343-b047-df133d2dbd98 req-b0ce1022-8c8c-4b38-acf0-0d21e7f8c70b service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:11.294279 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [req-f3f650ef-79d7-4343-b047-df133d2dbd98 req-b0ce1022-8c8c-4b38-acf0-0d21e7f8c70b service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:11.313261 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.compute.server_external_events [req-f3f650ef-79d7-4343-b047-df133d2dbd98 req-b0ce1022-8c8c-4b38-acf0-0d21e7f8c70b service nova] Creating event network-changed:4b3b90f0-95df-4c59-9186-169416370496 for instance 88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda on hv-cinder-84623 Jun 16 23:05:11.318361 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [req-f3f650ef-79d7-4343-b047-df133d2dbd98 req-b0ce1022-8c8c-4b38-acf0-0d21e7f8c70b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038640 Jun 16 23:05:11.319205 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 315/620] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 23:05:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 23:05:11.614516 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-25243927-2a4a-4400-9481-5364ac4ba876 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:05:11.615155 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-25243927-2a4a-4400-9481-5364ac4ba876 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:05:11.621711 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-25243927-2a4a-4400-9481-5364ac4ba876 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:11.622160 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-25243927-2a4a-4400-9481-5364ac4ba876 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:11.622952 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-25243927-2a4a-4400-9481-5364ac4ba876 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:11.623392 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-25243927-2a4a-4400-9481-5364ac4ba876 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:11.632716 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-ab7fd6b1-6eee-4bbd-b7d5-3fade7937163 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:05:11.633421 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-ab7fd6b1-6eee-4bbd-b7d5-3fade7937163 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] [instance: 30b2118a-225b-457b-a15d-cf7656c69331] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:05:11.636454 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG dbcounter [-] [117562] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=1,nova_api:INSERT=4,nova_api:UPDATE=2 {{(pid=117562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 23:05:11.641855 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-ab7fd6b1-6eee-4bbd-b7d5-3fade7937163 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:11.642316 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-ab7fd6b1-6eee-4bbd-b7d5-3fade7937163 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:11.643125 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-ab7fd6b1-6eee-4bbd-b7d5-3fade7937163 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:11.643568 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-ab7fd6b1-6eee-4bbd-b7d5-3fade7937163 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:11.913703 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-25243927-2a4a-4400-9481-5364ac4ba876 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:05:11.922744 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-25243927-2a4a-4400-9481-5364ac4ba876 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:05:11.924286 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-25243927-2a4a-4400-9481-5364ac4ba876 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:05:11.925858 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-25243927-2a4a-4400-9481-5364ac4ba876 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "GET /compute/v2.1/servers/88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda" status: 200 len: 1407 microversion: 2.20 time: 0.315121 Jun 16 23:05:11.926619 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 306/621] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 23:05:11 2022] GET /compute/v2.1/servers/88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda => generated 1407 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 23:05:11.932200 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-ab7fd6b1-6eee-4bbd-b7d5-3fade7937163 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3a2d16133b4af8a208682de8a7d111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0526c12e8bc947209e24daf5ddfad7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:05:11.946298 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-ab7fd6b1-6eee-4bbd-b7d5-3fade7937163 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] 10.222.0.17 "GET /compute/v2.1/servers/30b2118a-225b-457b-a15d-cf7656c69331" status: 200 len: 1366 microversion: 2.1 time: 0.318591 Jun 16 23:05:11.956003 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 316/622] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:05:11 2022] GET /compute/v2.1/servers/30b2118a-225b-457b-a15d-cf7656c69331 => generated 1366 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 23:05:12.943845 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-bb8fa956-ba06-4175-8221-3f2f21217dc9 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:05:12.944445 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-bb8fa956-ba06-4175-8221-3f2f21217dc9 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:05:12.951310 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-bb8fa956-ba06-4175-8221-3f2f21217dc9 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:12.951754 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-bb8fa956-ba06-4175-8221-3f2f21217dc9 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:12.952509 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-bb8fa956-ba06-4175-8221-3f2f21217dc9 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:12.952940 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-bb8fa956-ba06-4175-8221-3f2f21217dc9 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:12.963767 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-ecdd6581-57ba-4aab-9147-8ef88b9103e3 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:05:12.964375 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-ecdd6581-57ba-4aab-9147-8ef88b9103e3 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] [instance: 30b2118a-225b-457b-a15d-cf7656c69331] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:05:12.970280 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-ecdd6581-57ba-4aab-9147-8ef88b9103e3 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:12.970766 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-ecdd6581-57ba-4aab-9147-8ef88b9103e3 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:12.971538 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-ecdd6581-57ba-4aab-9147-8ef88b9103e3 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:12.971978 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-ecdd6581-57ba-4aab-9147-8ef88b9103e3 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:13.151255 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-bb8fa956-ba06-4175-8221-3f2f21217dc9 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:05:13.157648 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-ecdd6581-57ba-4aab-9147-8ef88b9103e3 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3a2d16133b4af8a208682de8a7d111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0526c12e8bc947209e24daf5ddfad7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:05:13.159236 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-bb8fa956-ba06-4175-8221-3f2f21217dc9 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:05:13.160821 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-bb8fa956-ba06-4175-8221-3f2f21217dc9 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:05:13.161995 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-bb8fa956-ba06-4175-8221-3f2f21217dc9 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "GET /compute/v2.1/servers/88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda" status: 200 len: 1407 microversion: 2.20 time: 0.222109 Jun 16 23:05:13.162545 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 307/623] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 23:05:12 2022] GET /compute/v2.1/servers/88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda => generated 1407 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 23:05:13.165007 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-ecdd6581-57ba-4aab-9147-8ef88b9103e3 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] 10.222.0.17 "GET /compute/v2.1/servers/30b2118a-225b-457b-a15d-cf7656c69331" status: 200 len: 1556 microversion: 2.1 time: 0.206024 Jun 16 23:05:13.165550 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 317/624] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:05:12 2022] GET /compute/v2.1/servers/30b2118a-225b-457b-a15d-cf7656c69331 => generated 1556 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 23:05:13.180890 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-72b3e731-72ae-4f4d-b1f7-24b0c591583d tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:05:13.181365 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-72b3e731-72ae-4f4d-b1f7-24b0c591583d tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] [instance: 30b2118a-225b-457b-a15d-cf7656c69331] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:05:13.183237 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG dbcounter [-] [117563] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=117563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 23:05:13.188445 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-72b3e731-72ae-4f4d-b1f7-24b0c591583d tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:13.188890 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-72b3e731-72ae-4f4d-b1f7-24b0c591583d tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:13.189641 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-72b3e731-72ae-4f4d-b1f7-24b0c591583d tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:13.190076 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-72b3e731-72ae-4f4d-b1f7-24b0c591583d tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:13.268264 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-72b3e731-72ae-4f4d-b1f7-24b0c591583d tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] 10.222.0.17 "GET /compute/v2.1/servers/30b2118a-225b-457b-a15d-cf7656c69331/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.091447 Jun 16 23:05:13.268860 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 308/625] 10.222.0.17 () {58 vars in 1274 bytes} [Thu Jun 16 23:05:13 2022] GET /compute/v2.1/servers/30b2118a-225b-457b-a15d-cf7656c69331/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 23:05:13.419506 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-8d30a68d-4942-4434-b0e2-e85ffa0c3d59 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 23:05:13.420069 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-8d30a68d-4942-4434-b0e2-e85ffa0c3d59 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] [instance: aa81794d-bc81-49d2-b4dc-6f57b43ecfe8] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:05:13.426051 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-8d30a68d-4942-4434-b0e2-e85ffa0c3d59 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:13.426614 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-8d30a68d-4942-4434-b0e2-e85ffa0c3d59 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:13.427448 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-8d30a68d-4942-4434-b0e2-e85ffa0c3d59 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:13.427887 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-8d30a68d-4942-4434-b0e2-e85ffa0c3d59 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:13.451235 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.objects.instance [None req-8d30a68d-4942-4434-b0e2-e85ffa0c3d59 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lazy-loading 'flavor' on Instance uuid aa81794d-bc81-49d2-b4dc-6f57b43ecfe8 {{(pid=117562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 23:05:13.522684 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-8d30a68d-4942-4434-b0e2-e85ffa0c3d59 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] 10.222.0.17 "POST /compute/v2.1/servers/aa81794d-bc81-49d2-b4dc-6f57b43ecfe8/action" status: 202 len: 0 microversion: 2.1 time: 0.106860 Jun 16 23:05:13.523291 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 318/626] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Jun 16 23:05:13 2022] POST /compute/v2.1/servers/aa81794d-bc81-49d2-b4dc-6f57b43ecfe8/action => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 23:05:13.531424 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-541f119b-ae04-4ca3-8a33-de6d3595e957 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:05:13.532029 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-541f119b-ae04-4ca3-8a33-de6d3595e957 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] [instance: aa81794d-bc81-49d2-b4dc-6f57b43ecfe8] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:05:13.538111 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-541f119b-ae04-4ca3-8a33-de6d3595e957 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:13.539072 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-541f119b-ae04-4ca3-8a33-de6d3595e957 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:13.539842 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-541f119b-ae04-4ca3-8a33-de6d3595e957 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:13.540296 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-541f119b-ae04-4ca3-8a33-de6d3595e957 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:13.684836 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-541f119b-ae04-4ca3-8a33-de6d3595e957 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01dd0e5661f44d05a01d7a5e82dbadf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b30b90ec4d5e45468a4fa0fb98e46393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:05:13.692239 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-541f119b-ae04-4ca3-8a33-de6d3595e957 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] 10.222.0.17 "GET /compute/v2.1/servers/aa81794d-bc81-49d2-b4dc-6f57b43ecfe8" status: 200 len: 1567 microversion: 2.1 time: 0.164605 Jun 16 23:05:13.692800 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 309/627] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:05:13 2022] GET /compute/v2.1/servers/aa81794d-bc81-49d2-b4dc-6f57b43ecfe8 => generated 1567 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:05:14.180277 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-4be5075f-2701-4d1b-842b-ff7b51d818e9 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:05:14.180980 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-4be5075f-2701-4d1b-842b-ff7b51d818e9 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:05:14.187767 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-4be5075f-2701-4d1b-842b-ff7b51d818e9 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:14.188211 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-4be5075f-2701-4d1b-842b-ff7b51d818e9 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:14.188985 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-4be5075f-2701-4d1b-842b-ff7b51d818e9 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:14.189420 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-4be5075f-2701-4d1b-842b-ff7b51d818e9 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:14.217564 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [req-bb04d41d-61db-4b45-a2ee-6abbfb0a1da6 req-315b8cec-6757-402a-9fd7-1254c3cebca9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30b2118a-225b-457b-a15d-cf7656c69331", "tag": "64041190-c0ec-441a-a5bb-be754b053d2d"}]} {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 23:05:14.228655 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-bb04d41d-61db-4b45-a2ee-6abbfb0a1da6 req-315b8cec-6757-402a-9fd7-1254c3cebca9 service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:14.229351 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-bb04d41d-61db-4b45-a2ee-6abbfb0a1da6 req-315b8cec-6757-402a-9fd7-1254c3cebca9 service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:14.245457 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.compute.server_external_events [req-bb04d41d-61db-4b45-a2ee-6abbfb0a1da6 req-315b8cec-6757-402a-9fd7-1254c3cebca9 service nova] Creating event network-changed:64041190-c0ec-441a-a5bb-be754b053d2d for instance 30b2118a-225b-457b-a15d-cf7656c69331 on hv-cinder-84623 Jun 16 23:05:14.250978 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [req-bb04d41d-61db-4b45-a2ee-6abbfb0a1da6 req-315b8cec-6757-402a-9fd7-1254c3cebca9 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037055 Jun 16 23:05:14.251569 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 310/628] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 23:05:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 23:05:14.372091 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-4be5075f-2701-4d1b-842b-ff7b51d818e9 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:05:14.381610 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-4be5075f-2701-4d1b-842b-ff7b51d818e9 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:05:14.383847 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-4be5075f-2701-4d1b-842b-ff7b51d818e9 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:05:14.385351 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-4be5075f-2701-4d1b-842b-ff7b51d818e9 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "GET /compute/v2.1/servers/88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda" status: 200 len: 1407 microversion: 2.20 time: 0.209395 Jun 16 23:05:14.386072 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 319/629] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 23:05:14 2022] GET /compute/v2.1/servers/88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda => generated 1407 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 23:05:14.710037 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-76893e4e-b1f2-4005-91ca-d1532777dd3c tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:05:14.710627 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-76893e4e-b1f2-4005-91ca-d1532777dd3c tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] [instance: aa81794d-bc81-49d2-b4dc-6f57b43ecfe8] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:05:14.717376 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-76893e4e-b1f2-4005-91ca-d1532777dd3c tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:14.718073 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-76893e4e-b1f2-4005-91ca-d1532777dd3c tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:14.718870 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-76893e4e-b1f2-4005-91ca-d1532777dd3c tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:14.719466 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-76893e4e-b1f2-4005-91ca-d1532777dd3c tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:14.913931 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-76893e4e-b1f2-4005-91ca-d1532777dd3c tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01dd0e5661f44d05a01d7a5e82dbadf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b30b90ec4d5e45468a4fa0fb98e46393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:05:14.921746 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-76893e4e-b1f2-4005-91ca-d1532777dd3c tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] 10.222.0.17 "GET /compute/v2.1/servers/aa81794d-bc81-49d2-b4dc-6f57b43ecfe8" status: 200 len: 1567 microversion: 2.1 time: 0.215986 Jun 16 23:05:14.922322 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 311/630] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:05:14 2022] GET /compute/v2.1/servers/aa81794d-bc81-49d2-b4dc-6f57b43ecfe8 => generated 1567 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:05:15.403702 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-cd3eb11a-32ea-42da-adc5-ab28972d9584 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:05:15.404305 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-cd3eb11a-32ea-42da-adc5-ab28972d9584 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:05:15.410834 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-cd3eb11a-32ea-42da-adc5-ab28972d9584 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:15.411284 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-cd3eb11a-32ea-42da-adc5-ab28972d9584 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:15.412046 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-cd3eb11a-32ea-42da-adc5-ab28972d9584 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:15.412484 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-cd3eb11a-32ea-42da-adc5-ab28972d9584 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:15.538803 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-cd3eb11a-32ea-42da-adc5-ab28972d9584 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:05:15.547457 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-cd3eb11a-32ea-42da-adc5-ab28972d9584 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:05:15.548950 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-cd3eb11a-32ea-42da-adc5-ab28972d9584 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:05:15.550049 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-cd3eb11a-32ea-42da-adc5-ab28972d9584 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "GET /compute/v2.1/servers/88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda" status: 200 len: 1407 microversion: 2.20 time: 0.150212 Jun 16 23:05:15.550621 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 320/631] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 23:05:15 2022] GET /compute/v2.1/servers/88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda => generated 1407 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 23:05:15.939307 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-7c059006-d586-4d41-93fc-ef8f9a4ef131 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:05:15.939918 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-7c059006-d586-4d41-93fc-ef8f9a4ef131 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] [instance: aa81794d-bc81-49d2-b4dc-6f57b43ecfe8] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:05:15.946813 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-7c059006-d586-4d41-93fc-ef8f9a4ef131 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:15.947264 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-7c059006-d586-4d41-93fc-ef8f9a4ef131 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:15.948026 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-7c059006-d586-4d41-93fc-ef8f9a4ef131 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:15.948463 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-7c059006-d586-4d41-93fc-ef8f9a4ef131 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:16.075732 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-7c059006-d586-4d41-93fc-ef8f9a4ef131 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01dd0e5661f44d05a01d7a5e82dbadf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b30b90ec4d5e45468a4fa0fb98e46393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:05:16.083171 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-7c059006-d586-4d41-93fc-ef8f9a4ef131 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] 10.222.0.17 "GET /compute/v2.1/servers/aa81794d-bc81-49d2-b4dc-6f57b43ecfe8" status: 200 len: 1567 microversion: 2.1 time: 0.147799 Jun 16 23:05:16.083735 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 312/632] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:05:15 2022] GET /compute/v2.1/servers/aa81794d-bc81-49d2-b4dc-6f57b43ecfe8 => generated 1567 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:05:16.567935 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-c439634f-2b5f-45ca-9ca3-d9f7d19d5c26 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:05:16.568476 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-c439634f-2b5f-45ca-9ca3-d9f7d19d5c26 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:05:16.574997 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-c439634f-2b5f-45ca-9ca3-d9f7d19d5c26 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:16.575450 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-c439634f-2b5f-45ca-9ca3-d9f7d19d5c26 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:16.576218 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-c439634f-2b5f-45ca-9ca3-d9f7d19d5c26 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:16.576657 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-c439634f-2b5f-45ca-9ca3-d9f7d19d5c26 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:16.708044 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-c439634f-2b5f-45ca-9ca3-d9f7d19d5c26 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:05:16.716568 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-c439634f-2b5f-45ca-9ca3-d9f7d19d5c26 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:05:16.718049 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-c439634f-2b5f-45ca-9ca3-d9f7d19d5c26 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:05:16.719172 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-c439634f-2b5f-45ca-9ca3-d9f7d19d5c26 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "GET /compute/v2.1/servers/88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda" status: 200 len: 1407 microversion: 2.20 time: 0.155248 Jun 16 23:05:16.719702 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 321/633] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 23:05:16 2022] GET /compute/v2.1/servers/88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 23:05:17.100287 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-6331426b-6f41-4c8c-ad5c-3e5a8f1b705b tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:05:17.101402 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-6331426b-6f41-4c8c-ad5c-3e5a8f1b705b tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] [instance: aa81794d-bc81-49d2-b4dc-6f57b43ecfe8] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:05:17.103366 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG dbcounter [-] [117563] Writing DB stats nova_cell0:SELECT=2 {{(pid=117563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 23:05:17.104117 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG dbcounter [-] [117563] Writing DB stats nova_cell0:SELECT=14 {{(pid=117563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 23:05:17.110187 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-6331426b-6f41-4c8c-ad5c-3e5a8f1b705b tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:17.111036 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-6331426b-6f41-4c8c-ad5c-3e5a8f1b705b tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:17.111439 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-6331426b-6f41-4c8c-ad5c-3e5a8f1b705b tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:17.111922 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-6331426b-6f41-4c8c-ad5c-3e5a8f1b705b tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:17.240808 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-6331426b-6f41-4c8c-ad5c-3e5a8f1b705b tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01dd0e5661f44d05a01d7a5e82dbadf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b30b90ec4d5e45468a4fa0fb98e46393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:05:17.248851 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-6331426b-6f41-4c8c-ad5c-3e5a8f1b705b tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] 10.222.0.17 "GET /compute/v2.1/servers/aa81794d-bc81-49d2-b4dc-6f57b43ecfe8" status: 200 len: 1567 microversion: 2.1 time: 0.152608 Jun 16 23:05:17.249439 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 313/634] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:05:17 2022] GET /compute/v2.1/servers/aa81794d-bc81-49d2-b4dc-6f57b43ecfe8 => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:05:17.737229 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-69ea3791-122b-49a7-9692-5e852fe8b297 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:05:17.737784 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-69ea3791-122b-49a7-9692-5e852fe8b297 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:05:17.744692 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-69ea3791-122b-49a7-9692-5e852fe8b297 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:17.745165 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-69ea3791-122b-49a7-9692-5e852fe8b297 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:17.745917 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-69ea3791-122b-49a7-9692-5e852fe8b297 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:17.746362 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-69ea3791-122b-49a7-9692-5e852fe8b297 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:17.880464 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-69ea3791-122b-49a7-9692-5e852fe8b297 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:05:17.889045 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-69ea3791-122b-49a7-9692-5e852fe8b297 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:05:17.890797 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-69ea3791-122b-49a7-9692-5e852fe8b297 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:05:17.891933 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-69ea3791-122b-49a7-9692-5e852fe8b297 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "GET /compute/v2.1/servers/88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda" status: 200 len: 1407 microversion: 2.20 time: 0.158685 Jun 16 23:05:17.892718 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 322/635] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 23:05:17 2022] GET /compute/v2.1/servers/88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda => generated 1407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 23:05:18.265234 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-1955dddc-3310-48c0-8f54-e73872825ee5 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:05:18.265841 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-1955dddc-3310-48c0-8f54-e73872825ee5 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] [instance: aa81794d-bc81-49d2-b4dc-6f57b43ecfe8] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:05:18.272806 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-1955dddc-3310-48c0-8f54-e73872825ee5 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:18.273256 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-1955dddc-3310-48c0-8f54-e73872825ee5 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:18.274017 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-1955dddc-3310-48c0-8f54-e73872825ee5 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:18.274453 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-1955dddc-3310-48c0-8f54-e73872825ee5 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:18.409475 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-1955dddc-3310-48c0-8f54-e73872825ee5 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01dd0e5661f44d05a01d7a5e82dbadf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b30b90ec4d5e45468a4fa0fb98e46393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:05:18.417442 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-1955dddc-3310-48c0-8f54-e73872825ee5 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] 10.222.0.17 "GET /compute/v2.1/servers/aa81794d-bc81-49d2-b4dc-6f57b43ecfe8" status: 200 len: 1567 microversion: 2.1 time: 0.156148 Jun 16 23:05:18.418004 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 314/636] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:05:18 2022] GET /compute/v2.1/servers/aa81794d-bc81-49d2-b4dc-6f57b43ecfe8 => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:05:18.902488 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [req-ce26b30e-a74f-41e8-8054-b163a3f9565a req-d28cca19-7a41-4f12-9fb2-c744f40b487a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda", "name": "network-vif-plugged", "status": "completed", "tag": "4b3b90f0-95df-4c59-9186-169416370496"}]} {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 23:05:18.910622 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-dc49a66e-edcd-4593-aa30-1e9cef35f56d tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:05:18.912839 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [req-ce26b30e-a74f-41e8-8054-b163a3f9565a req-d28cca19-7a41-4f12-9fb2-c744f40b487a service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:18.913275 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [req-ce26b30e-a74f-41e8-8054-b163a3f9565a req-d28cca19-7a41-4f12-9fb2-c744f40b487a service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:18.922383 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-dc49a66e-edcd-4593-aa30-1e9cef35f56d tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:05:18.925343 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.compute.server_external_events [req-ce26b30e-a74f-41e8-8054-b163a3f9565a req-d28cca19-7a41-4f12-9fb2-c744f40b487a service nova] Creating event network-vif-plugged:4b3b90f0-95df-4c59-9186-169416370496 for instance 88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda on hv-cinder-84623 Jun 16 23:05:18.930491 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [req-ce26b30e-a74f-41e8-8054-b163a3f9565a req-d28cca19-7a41-4f12-9fb2-c744f40b487a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031638 Jun 16 23:05:18.931119 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 323/637] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 23:05:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 23:05:18.934715 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-dc49a66e-edcd-4593-aa30-1e9cef35f56d tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:18.935169 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-dc49a66e-edcd-4593-aa30-1e9cef35f56d tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:18.936002 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-dc49a66e-edcd-4593-aa30-1e9cef35f56d tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:18.936852 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-dc49a66e-edcd-4593-aa30-1e9cef35f56d tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:18.941857 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG dbcounter [-] [117563] Writing DB stats nova_cell1:SELECT=100 {{(pid=117563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 23:05:19.089132 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-dc49a66e-edcd-4593-aa30-1e9cef35f56d tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:05:19.097471 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-dc49a66e-edcd-4593-aa30-1e9cef35f56d tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:05:19.099248 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-dc49a66e-edcd-4593-aa30-1e9cef35f56d tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:05:19.100800 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-dc49a66e-edcd-4593-aa30-1e9cef35f56d tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "GET /compute/v2.1/servers/88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda" status: 200 len: 1407 microversion: 2.20 time: 0.194334 Jun 16 23:05:19.101424 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 315/638] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 23:05:18 2022] GET /compute/v2.1/servers/88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda => generated 1407 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 23:05:19.435455 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-08ae4582-c316-4373-b425-715c69d5fcf8 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:05:19.436543 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-08ae4582-c316-4373-b425-715c69d5fcf8 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] [instance: aa81794d-bc81-49d2-b4dc-6f57b43ecfe8] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:05:19.444011 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-08ae4582-c316-4373-b425-715c69d5fcf8 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:19.444836 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-08ae4582-c316-4373-b425-715c69d5fcf8 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:19.445623 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-08ae4582-c316-4373-b425-715c69d5fcf8 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:19.446122 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-08ae4582-c316-4373-b425-715c69d5fcf8 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:19.578259 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-08ae4582-c316-4373-b425-715c69d5fcf8 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01dd0e5661f44d05a01d7a5e82dbadf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b30b90ec4d5e45468a4fa0fb98e46393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:05:19.585638 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-08ae4582-c316-4373-b425-715c69d5fcf8 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] 10.222.0.17 "GET /compute/v2.1/servers/aa81794d-bc81-49d2-b4dc-6f57b43ecfe8" status: 200 len: 1567 microversion: 2.1 time: 0.154410 Jun 16 23:05:19.586492 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 324/639] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:05:19 2022] GET /compute/v2.1/servers/aa81794d-bc81-49d2-b4dc-6f57b43ecfe8 => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:05:19.726127 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-1118052b-5c1c-4e80-905f-29f0eaf46564 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:05:19.726643 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-1118052b-5c1c-4e80-905f-29f0eaf46564 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] [instance: 8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:05:19.732992 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-1118052b-5c1c-4e80-905f-29f0eaf46564 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:19.733443 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-1118052b-5c1c-4e80-905f-29f0eaf46564 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:19.734207 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-1118052b-5c1c-4e80-905f-29f0eaf46564 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:19.734676 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-1118052b-5c1c-4e80-905f-29f0eaf46564 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:19.818662 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.objects.instance [None req-1118052b-5c1c-4e80-905f-29f0eaf46564 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lazy-loading 'services' on Instance uuid 8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8 {{(pid=117563) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 23:05:19.889287 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-1118052b-5c1c-4e80-905f-29f0eaf46564 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] 10.222.0.17 "DELETE /compute/v2.1/servers/8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8/os-volume_attachments/69f331a4-aab1-45fb-8cec-8bbb86e65d81" status: 202 len: 0 microversion: 2.1 time: 0.167391 Jun 16 23:05:19.889873 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 316/640] 10.222.0.17 () {58 vars in 1415 bytes} [Thu Jun 16 23:05:19 2022] DELETE /compute/v2.1/servers/8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8/os-volume_attachments/69f331a4-aab1-45fb-8cec-8bbb86e65d81 => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 23:05:19.898670 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-0388b3e7-8d6f-4fb3-9989-3999c7bf4bda tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:05:19.899642 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-0388b3e7-8d6f-4fb3-9989-3999c7bf4bda tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] [instance: 8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:05:19.905533 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-0388b3e7-8d6f-4fb3-9989-3999c7bf4bda tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:19.906108 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-0388b3e7-8d6f-4fb3-9989-3999c7bf4bda tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:19.906819 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-0388b3e7-8d6f-4fb3-9989-3999c7bf4bda tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:19.907256 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-0388b3e7-8d6f-4fb3-9989-3999c7bf4bda tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:19.936191 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-0388b3e7-8d6f-4fb3-9989-3999c7bf4bda tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] 10.222.0.17 "GET /compute/v2.1/servers/8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041991 Jun 16 23:05:19.936725 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 325/641] 10.222.0.17 () {58 vars in 1301 bytes} [Thu Jun 16 23:05:19 2022] GET /compute/v2.1/servers/8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 23:05:20.120363 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-af2a539e-4460-4cdd-9778-76c5c0d33e6a tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:05:20.121315 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-af2a539e-4460-4cdd-9778-76c5c0d33e6a tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:05:20.129153 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-af2a539e-4460-4cdd-9778-76c5c0d33e6a tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:20.129629 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-af2a539e-4460-4cdd-9778-76c5c0d33e6a tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:20.130412 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-af2a539e-4460-4cdd-9778-76c5c0d33e6a tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:20.130877 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-af2a539e-4460-4cdd-9778-76c5c0d33e6a tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:20.274174 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-af2a539e-4460-4cdd-9778-76c5c0d33e6a tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:05:20.282083 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-af2a539e-4460-4cdd-9778-76c5c0d33e6a tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:05:20.283621 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-af2a539e-4460-4cdd-9778-76c5c0d33e6a tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:05:20.284754 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-af2a539e-4460-4cdd-9778-76c5c0d33e6a tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "GET /compute/v2.1/servers/88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda" status: 200 len: 1407 microversion: 2.20 time: 0.169486 Jun 16 23:05:20.285313 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 317/642] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 23:05:20 2022] GET /compute/v2.1/servers/88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda => generated 1407 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 23:05:20.602807 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-fbefa190-31ac-4b0c-9f95-7b8f19dc0ccb tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:05:20.603299 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-fbefa190-31ac-4b0c-9f95-7b8f19dc0ccb tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] [instance: aa81794d-bc81-49d2-b4dc-6f57b43ecfe8] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:05:20.609141 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-fbefa190-31ac-4b0c-9f95-7b8f19dc0ccb tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:20.609588 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-fbefa190-31ac-4b0c-9f95-7b8f19dc0ccb tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:20.610344 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-fbefa190-31ac-4b0c-9f95-7b8f19dc0ccb tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:20.610799 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-fbefa190-31ac-4b0c-9f95-7b8f19dc0ccb tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:20.741164 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-fbefa190-31ac-4b0c-9f95-7b8f19dc0ccb tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01dd0e5661f44d05a01d7a5e82dbadf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b30b90ec4d5e45468a4fa0fb98e46393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:05:20.749913 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-fbefa190-31ac-4b0c-9f95-7b8f19dc0ccb tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] 10.222.0.17 "GET /compute/v2.1/servers/aa81794d-bc81-49d2-b4dc-6f57b43ecfe8" status: 200 len: 1567 microversion: 2.1 time: 0.151038 Jun 16 23:05:20.750489 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 326/643] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:05:20 2022] GET /compute/v2.1/servers/aa81794d-bc81-49d2-b4dc-6f57b43ecfe8 => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:05:20.947394 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-a6075450-95e5-49fc-a4ca-a2f0d5e8dbe1 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:05:20.948385 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-a6075450-95e5-49fc-a4ca-a2f0d5e8dbe1 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] [instance: 8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:05:20.954848 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-a6075450-95e5-49fc-a4ca-a2f0d5e8dbe1 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:20.955303 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-a6075450-95e5-49fc-a4ca-a2f0d5e8dbe1 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:20.956070 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-a6075450-95e5-49fc-a4ca-a2f0d5e8dbe1 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:20.956510 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-a6075450-95e5-49fc-a4ca-a2f0d5e8dbe1 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:20.985048 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-a6075450-95e5-49fc-a4ca-a2f0d5e8dbe1 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] 10.222.0.17 "GET /compute/v2.1/servers/8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041714 Jun 16 23:05:20.985590 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 318/644] 10.222.0.17 () {58 vars in 1301 bytes} [Thu Jun 16 23:05:20 2022] GET /compute/v2.1/servers/8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 23:05:21.308265 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-21f685ea-bf16-4ed0-822a-119b4a48f2d8 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:05:21.308888 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-21f685ea-bf16-4ed0-822a-119b4a48f2d8 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:05:21.315490 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-21f685ea-bf16-4ed0-822a-119b4a48f2d8 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:21.315944 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-21f685ea-bf16-4ed0-822a-119b4a48f2d8 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:21.316716 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-21f685ea-bf16-4ed0-822a-119b4a48f2d8 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:21.317191 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-21f685ea-bf16-4ed0-822a-119b4a48f2d8 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:21.471067 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-21f685ea-bf16-4ed0-822a-119b4a48f2d8 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:05:21.479669 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-21f685ea-bf16-4ed0-822a-119b4a48f2d8 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:05:21.481102 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-21f685ea-bf16-4ed0-822a-119b4a48f2d8 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:05:21.482241 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-21f685ea-bf16-4ed0-822a-119b4a48f2d8 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "GET /compute/v2.1/servers/88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda" status: 200 len: 1599 microversion: 2.20 time: 0.183737 Jun 16 23:05:21.482828 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 327/645] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 23:05:21 2022] GET /compute/v2.1/servers/88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda => generated 1599 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 23:05:21.499744 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-920ff499-0264-4982-8627-856f1744ad31 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:05:21.500568 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-920ff499-0264-4982-8627-856f1744ad31 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:05:21.507329 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-920ff499-0264-4982-8627-856f1744ad31 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:21.507837 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-920ff499-0264-4982-8627-856f1744ad31 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:21.508654 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-920ff499-0264-4982-8627-856f1744ad31 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:21.509272 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-920ff499-0264-4982-8627-856f1744ad31 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:21.591671 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-920ff499-0264-4982-8627-856f1744ad31 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "GET /compute/v2.1/servers/88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.095721 Jun 16 23:05:21.592273 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 319/646] 10.222.0.17 () {60 vars in 1315 bytes} [Thu Jun 16 23:05:21 2022] GET /compute/v2.1/servers/88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 23:05:21.767607 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-3d13be3a-90f0-4917-ab3b-3d2b64ccf111 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:05:21.768209 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-3d13be3a-90f0-4917-ab3b-3d2b64ccf111 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] [instance: aa81794d-bc81-49d2-b4dc-6f57b43ecfe8] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:05:21.774207 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-3d13be3a-90f0-4917-ab3b-3d2b64ccf111 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:21.774684 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-3d13be3a-90f0-4917-ab3b-3d2b64ccf111 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:21.775450 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-3d13be3a-90f0-4917-ab3b-3d2b64ccf111 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:21.775881 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-3d13be3a-90f0-4917-ab3b-3d2b64ccf111 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:21.998020 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-daa1ce85-8239-4db7-9b3a-9b0c194182d0 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:05:21.999705 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-daa1ce85-8239-4db7-9b3a-9b0c194182d0 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] [instance: 8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:05:22.005958 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-daa1ce85-8239-4db7-9b3a-9b0c194182d0 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:22.006527 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-daa1ce85-8239-4db7-9b3a-9b0c194182d0 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:22.007453 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-daa1ce85-8239-4db7-9b3a-9b0c194182d0 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:22.008100 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-daa1ce85-8239-4db7-9b3a-9b0c194182d0 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:22.038330 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-3d13be3a-90f0-4917-ab3b-3d2b64ccf111 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01dd0e5661f44d05a01d7a5e82dbadf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b30b90ec4d5e45468a4fa0fb98e46393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:05:22.045832 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-daa1ce85-8239-4db7-9b3a-9b0c194182d0 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] 10.222.0.17 "GET /compute/v2.1/servers/8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052399 Jun 16 23:05:22.048370 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-3d13be3a-90f0-4917-ab3b-3d2b64ccf111 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] 10.222.0.17 "GET /compute/v2.1/servers/aa81794d-bc81-49d2-b4dc-6f57b43ecfe8" status: 200 len: 1567 microversion: 2.1 time: 0.283615 Jun 16 23:05:22.049588 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 328/647] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:05:21 2022] GET /compute/v2.1/servers/aa81794d-bc81-49d2-b4dc-6f57b43ecfe8 => generated 1567 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:05:22.051611 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 320/648] 10.222.0.17 () {58 vars in 1301 bytes} [Thu Jun 16 23:05:21 2022] GET /compute/v2.1/servers/8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 16 23:05:22.131741 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-c275e0aa-662f-4819-bec0-31d5176f7015 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:05:22.132385 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-c275e0aa-662f-4819-bec0-31d5176f7015 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] [instance: 8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:05:22.138539 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-c275e0aa-662f-4819-bec0-31d5176f7015 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:22.139418 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-c275e0aa-662f-4819-bec0-31d5176f7015 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:22.140191 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-c275e0aa-662f-4819-bec0-31d5176f7015 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:22.140703 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-c275e0aa-662f-4819-bec0-31d5176f7015 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:22.169182 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-c275e0aa-662f-4819-bec0-31d5176f7015 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] [instance: 8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8] Going to try to terminate instance {{(pid=117562) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 23:05:22.184632 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG dbcounter [-] [117562] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 23:05:22.266890 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-c275e0aa-662f-4819-bec0-31d5176f7015 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] 10.222.0.17 "DELETE /compute/v2.1/servers/8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8" status: 204 len: 0 microversion: 2.1 time: 0.138222 Jun 16 23:05:22.268296 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 329/649] 10.222.0.17 () {58 vars in 1238 bytes} [Thu Jun 16 23:05:22 2022] DELETE /compute/v2.1/servers/8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 23:05:22.276789 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-8a8d4c37-e43c-4ebf-aea3-121c51938ae7 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:05:22.277398 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-8a8d4c37-e43c-4ebf-aea3-121c51938ae7 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] [instance: 8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:05:22.297351 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-8a8d4c37-e43c-4ebf-aea3-121c51938ae7 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:22.297805 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-8a8d4c37-e43c-4ebf-aea3-121c51938ae7 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:22.298610 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-8a8d4c37-e43c-4ebf-aea3-121c51938ae7 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:22.299076 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-8a8d4c37-e43c-4ebf-aea3-121c51938ae7 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:22.531636 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-8a8d4c37-e43c-4ebf-aea3-121c51938ae7 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '243e592fbf1844d89f55dd5035a684f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60447df5461141e883d207e028b74bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:05:22.539777 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-8a8d4c37-e43c-4ebf-aea3-121c51938ae7 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] 10.222.0.17 "GET /compute/v2.1/servers/8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8" status: 200 len: 1689 microversion: 2.1 time: 0.266836 Jun 16 23:05:22.540487 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 321/650] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:05:22 2022] GET /compute/v2.1/servers/8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8 => generated 1689 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:05:22.750057 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [req-f10bbdac-613e-44eb-949a-d7b891b42b13 req-4d90c312-0669-4b3e-90cf-bedfde3576e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda", "tag": "4b3b90f0-95df-4c59-9186-169416370496"}]} {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 23:05:22.760223 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [req-f10bbdac-613e-44eb-949a-d7b891b42b13 req-4d90c312-0669-4b3e-90cf-bedfde3576e0 service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:22.760755 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [req-f10bbdac-613e-44eb-949a-d7b891b42b13 req-4d90c312-0669-4b3e-90cf-bedfde3576e0 service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:22.773919 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.compute.server_external_events [req-f10bbdac-613e-44eb-949a-d7b891b42b13 req-4d90c312-0669-4b3e-90cf-bedfde3576e0 service nova] Creating event network-changed:4b3b90f0-95df-4c59-9186-169416370496 for instance 88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda on hv-cinder-84623 Jun 16 23:05:22.779519 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [req-f10bbdac-613e-44eb-949a-d7b891b42b13 req-4d90c312-0669-4b3e-90cf-bedfde3576e0 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034121 Jun 16 23:05:22.780105 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 330/651] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 23:05:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 23:05:23.065733 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-4cf11cf8-cd13-46b7-b090-a1601425eca4 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:05:23.066954 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-4cf11cf8-cd13-46b7-b090-a1601425eca4 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] [instance: aa81794d-bc81-49d2-b4dc-6f57b43ecfe8] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:05:23.075796 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-4cf11cf8-cd13-46b7-b090-a1601425eca4 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:23.076817 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-4cf11cf8-cd13-46b7-b090-a1601425eca4 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:23.077744 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-4cf11cf8-cd13-46b7-b090-a1601425eca4 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:23.078496 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-4cf11cf8-cd13-46b7-b090-a1601425eca4 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:23.499688 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-4cf11cf8-cd13-46b7-b090-a1601425eca4 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01dd0e5661f44d05a01d7a5e82dbadf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b30b90ec4d5e45468a4fa0fb98e46393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:05:23.509897 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-4cf11cf8-cd13-46b7-b090-a1601425eca4 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] 10.222.0.17 "GET /compute/v2.1/servers/aa81794d-bc81-49d2-b4dc-6f57b43ecfe8" status: 200 len: 1567 microversion: 2.1 time: 0.448408 Jun 16 23:05:23.510966 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 322/652] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:05:23 2022] GET /compute/v2.1/servers/aa81794d-bc81-49d2-b4dc-6f57b43ecfe8 => generated 1567 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:05:23.557862 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-26e9f90d-4dae-4a28-8eb8-c303308e74f4 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:05:23.558560 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-26e9f90d-4dae-4a28-8eb8-c303308e74f4 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] [instance: 8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:05:23.565399 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-26e9f90d-4dae-4a28-8eb8-c303308e74f4 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:23.565856 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-26e9f90d-4dae-4a28-8eb8-c303308e74f4 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:23.566672 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-26e9f90d-4dae-4a28-8eb8-c303308e74f4 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:23.567118 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-26e9f90d-4dae-4a28-8eb8-c303308e74f4 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:23.707376 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-26e9f90d-4dae-4a28-8eb8-c303308e74f4 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '243e592fbf1844d89f55dd5035a684f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60447df5461141e883d207e028b74bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:05:23.716697 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-26e9f90d-4dae-4a28-8eb8-c303308e74f4 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] 10.222.0.17 "GET /compute/v2.1/servers/8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8" status: 200 len: 1689 microversion: 2.1 time: 0.163313 Jun 16 23:05:23.717273 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 331/653] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:05:23 2022] GET /compute/v2.1/servers/8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8 => generated 1689 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:05:24.527123 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-de9090b0-077a-4cb1-9e1c-ed73f4f10390 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:05:24.527686 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-de9090b0-077a-4cb1-9e1c-ed73f4f10390 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] [instance: aa81794d-bc81-49d2-b4dc-6f57b43ecfe8] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:05:24.534171 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-de9090b0-077a-4cb1-9e1c-ed73f4f10390 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:24.534662 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-de9090b0-077a-4cb1-9e1c-ed73f4f10390 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:24.535432 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-de9090b0-077a-4cb1-9e1c-ed73f4f10390 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:24.535871 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-de9090b0-077a-4cb1-9e1c-ed73f4f10390 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:24.671004 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-de9090b0-077a-4cb1-9e1c-ed73f4f10390 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01dd0e5661f44d05a01d7a5e82dbadf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b30b90ec4d5e45468a4fa0fb98e46393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:05:24.679253 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-de9090b0-077a-4cb1-9e1c-ed73f4f10390 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] 10.222.0.17 "GET /compute/v2.1/servers/aa81794d-bc81-49d2-b4dc-6f57b43ecfe8" status: 200 len: 1567 microversion: 2.1 time: 0.155967 Jun 16 23:05:24.679835 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 323/654] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:05:24 2022] GET /compute/v2.1/servers/aa81794d-bc81-49d2-b4dc-6f57b43ecfe8 => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:05:24.734120 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-6907e8cc-fb84-49ca-958f-4ebd5fb27e62 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:05:24.734748 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-6907e8cc-fb84-49ca-958f-4ebd5fb27e62 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] [instance: 8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:05:24.741962 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-6907e8cc-fb84-49ca-958f-4ebd5fb27e62 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:24.742333 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-6907e8cc-fb84-49ca-958f-4ebd5fb27e62 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:24.743139 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-6907e8cc-fb84-49ca-958f-4ebd5fb27e62 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:24.743581 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-6907e8cc-fb84-49ca-958f-4ebd5fb27e62 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:24.897197 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-6907e8cc-fb84-49ca-958f-4ebd5fb27e62 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '243e592fbf1844d89f55dd5035a684f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60447df5461141e883d207e028b74bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:05:24.904658 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-6907e8cc-fb84-49ca-958f-4ebd5fb27e62 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] 10.222.0.17 "GET /compute/v2.1/servers/8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8" status: 200 len: 1689 microversion: 2.1 time: 0.174364 Jun 16 23:05:24.905221 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 332/655] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:05:24 2022] GET /compute/v2.1/servers/8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8 => generated 1689 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:05:25.696432 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-7eda278b-0bb8-4d4b-acc3-3039516b8f19 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:05:25.697035 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-7eda278b-0bb8-4d4b-acc3-3039516b8f19 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] [instance: aa81794d-bc81-49d2-b4dc-6f57b43ecfe8] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:05:25.703493 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-7eda278b-0bb8-4d4b-acc3-3039516b8f19 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:25.703944 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-7eda278b-0bb8-4d4b-acc3-3039516b8f19 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:25.704712 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-7eda278b-0bb8-4d4b-acc3-3039516b8f19 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:25.705186 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-7eda278b-0bb8-4d4b-acc3-3039516b8f19 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:25.831936 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-7eda278b-0bb8-4d4b-acc3-3039516b8f19 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01dd0e5661f44d05a01d7a5e82dbadf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b30b90ec4d5e45468a4fa0fb98e46393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:05:25.840192 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-7eda278b-0bb8-4d4b-acc3-3039516b8f19 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] 10.222.0.17 "GET /compute/v2.1/servers/aa81794d-bc81-49d2-b4dc-6f57b43ecfe8" status: 200 len: 1567 microversion: 2.1 time: 0.148167 Jun 16 23:05:25.840755 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 324/656] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:05:25 2022] GET /compute/v2.1/servers/aa81794d-bc81-49d2-b4dc-6f57b43ecfe8 => generated 1567 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:05:25.921801 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-eac14a57-2538-448b-a958-3256236f7e62 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:05:25.922411 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-eac14a57-2538-448b-a958-3256236f7e62 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] [instance: 8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:05:25.929020 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-eac14a57-2538-448b-a958-3256236f7e62 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:25.929472 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-eac14a57-2538-448b-a958-3256236f7e62 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:25.930238 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-eac14a57-2538-448b-a958-3256236f7e62 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:25.930708 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-eac14a57-2538-448b-a958-3256236f7e62 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:26.061514 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-eac14a57-2538-448b-a958-3256236f7e62 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '243e592fbf1844d89f55dd5035a684f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60447df5461141e883d207e028b74bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:05:26.069144 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-eac14a57-2538-448b-a958-3256236f7e62 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] 10.222.0.17 "GET /compute/v2.1/servers/8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8" status: 200 len: 1689 microversion: 2.1 time: 0.151313 Jun 16 23:05:26.069705 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 333/657] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:05:25 2022] GET /compute/v2.1/servers/8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8 => generated 1689 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:05:26.856850 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-a0b5689c-3d6a-4919-82a8-380b3580846b tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:05:26.857490 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-a0b5689c-3d6a-4919-82a8-380b3580846b tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] [instance: aa81794d-bc81-49d2-b4dc-6f57b43ecfe8] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:05:26.863897 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-a0b5689c-3d6a-4919-82a8-380b3580846b tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:26.864384 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-a0b5689c-3d6a-4919-82a8-380b3580846b tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:26.865152 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-a0b5689c-3d6a-4919-82a8-380b3580846b tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:26.865592 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-a0b5689c-3d6a-4919-82a8-380b3580846b tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:26.993442 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-a0b5689c-3d6a-4919-82a8-380b3580846b tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01dd0e5661f44d05a01d7a5e82dbadf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b30b90ec4d5e45468a4fa0fb98e46393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:05:27.000792 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-a0b5689c-3d6a-4919-82a8-380b3580846b tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] 10.222.0.17 "GET /compute/v2.1/servers/aa81794d-bc81-49d2-b4dc-6f57b43ecfe8" status: 200 len: 1567 microversion: 2.1 time: 0.147808 Jun 16 23:05:27.001348 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 325/658] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:05:26 2022] GET /compute/v2.1/servers/aa81794d-bc81-49d2-b4dc-6f57b43ecfe8 => generated 1567 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:05:27.086562 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-ce41222f-0f3d-4357-8dfc-b1cc9eb022c7 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:05:27.087192 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-ce41222f-0f3d-4357-8dfc-b1cc9eb022c7 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] [instance: 8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:05:27.093566 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-ce41222f-0f3d-4357-8dfc-b1cc9eb022c7 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:27.094016 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-ce41222f-0f3d-4357-8dfc-b1cc9eb022c7 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:27.094812 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-ce41222f-0f3d-4357-8dfc-b1cc9eb022c7 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:27.095252 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-ce41222f-0f3d-4357-8dfc-b1cc9eb022c7 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:27.222583 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-ce41222f-0f3d-4357-8dfc-b1cc9eb022c7 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '243e592fbf1844d89f55dd5035a684f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60447df5461141e883d207e028b74bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:05:27.230055 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-ce41222f-0f3d-4357-8dfc-b1cc9eb022c7 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] 10.222.0.17 "GET /compute/v2.1/servers/8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8" status: 200 len: 1689 microversion: 2.1 time: 0.148138 Jun 16 23:05:27.230633 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 334/659] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:05:27 2022] GET /compute/v2.1/servers/8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8 => generated 1689 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:05:28.017452 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-2735a6b0-9490-43ac-aa9d-76e24fb16ecb tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:05:28.018092 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-2735a6b0-9490-43ac-aa9d-76e24fb16ecb tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] [instance: aa81794d-bc81-49d2-b4dc-6f57b43ecfe8] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:05:28.025027 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-2735a6b0-9490-43ac-aa9d-76e24fb16ecb tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:28.025481 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-2735a6b0-9490-43ac-aa9d-76e24fb16ecb tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:28.026259 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-2735a6b0-9490-43ac-aa9d-76e24fb16ecb tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:28.026725 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-2735a6b0-9490-43ac-aa9d-76e24fb16ecb tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:28.208270 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-2735a6b0-9490-43ac-aa9d-76e24fb16ecb tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01dd0e5661f44d05a01d7a5e82dbadf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b30b90ec4d5e45468a4fa0fb98e46393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:05:28.216151 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-2735a6b0-9490-43ac-aa9d-76e24fb16ecb tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] 10.222.0.17 "GET /compute/v2.1/servers/aa81794d-bc81-49d2-b4dc-6f57b43ecfe8" status: 200 len: 1567 microversion: 2.1 time: 0.202770 Jun 16 23:05:28.216720 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 326/660] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:05:28 2022] GET /compute/v2.1/servers/aa81794d-bc81-49d2-b4dc-6f57b43ecfe8 => generated 1567 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 23:05:28.246695 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-ca190187-93a4-4fed-ad5e-19cbdd285580 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:05:28.247306 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-ca190187-93a4-4fed-ad5e-19cbdd285580 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] [instance: 8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:05:28.253808 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-ca190187-93a4-4fed-ad5e-19cbdd285580 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:28.254256 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-ca190187-93a4-4fed-ad5e-19cbdd285580 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:28.255063 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-ca190187-93a4-4fed-ad5e-19cbdd285580 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:28.256157 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-ca190187-93a4-4fed-ad5e-19cbdd285580 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:28.469006 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-ca190187-93a4-4fed-ad5e-19cbdd285580 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '243e592fbf1844d89f55dd5035a684f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60447df5461141e883d207e028b74bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:05:28.478343 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-ca190187-93a4-4fed-ad5e-19cbdd285580 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] 10.222.0.17 "GET /compute/v2.1/servers/8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8" status: 200 len: 1689 microversion: 2.1 time: 0.234695 Jun 16 23:05:28.478343 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 335/661] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:05:28 2022] GET /compute/v2.1/servers/8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8 => generated 1689 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:05:29.232402 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-0599b738-4eb2-4fb3-8a48-cc29b8973614 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:05:29.233032 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-0599b738-4eb2-4fb3-8a48-cc29b8973614 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] [instance: aa81794d-bc81-49d2-b4dc-6f57b43ecfe8] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:05:29.239743 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-0599b738-4eb2-4fb3-8a48-cc29b8973614 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:29.240259 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-0599b738-4eb2-4fb3-8a48-cc29b8973614 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:29.241094 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-0599b738-4eb2-4fb3-8a48-cc29b8973614 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:29.241618 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-0599b738-4eb2-4fb3-8a48-cc29b8973614 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:29.369839 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [req-d28091fa-455d-4af0-b018-1cff2780ce63 req-675a611d-66a6-43c6-af5e-688800fd7572 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8", "name": "network-vif-deleted", "tag": "823b7d46-8462-4945-943b-09a9fc1c8dce"}]} {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 23:05:29.378566 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [req-d28091fa-455d-4af0-b018-1cff2780ce63 req-675a611d-66a6-43c6-af5e-688800fd7572 service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:29.379108 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [req-d28091fa-455d-4af0-b018-1cff2780ce63 req-675a611d-66a6-43c6-af5e-688800fd7572 service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:29.381163 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-0599b738-4eb2-4fb3-8a48-cc29b8973614 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01dd0e5661f44d05a01d7a5e82dbadf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b30b90ec4d5e45468a4fa0fb98e46393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:05:29.390962 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.compute.server_external_events [req-d28091fa-455d-4af0-b018-1cff2780ce63 req-675a611d-66a6-43c6-af5e-688800fd7572 service nova] Creating event network-vif-deleted:823b7d46-8462-4945-943b-09a9fc1c8dce for instance 8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8 on hv-cinder-84623 Jun 16 23:05:29.392739 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-0599b738-4eb2-4fb3-8a48-cc29b8973614 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] 10.222.0.17 "GET /compute/v2.1/servers/aa81794d-bc81-49d2-b4dc-6f57b43ecfe8" status: 200 len: 1567 microversion: 2.1 time: 0.164111 Jun 16 23:05:29.394873 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 327/662] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:05:29 2022] GET /compute/v2.1/servers/aa81794d-bc81-49d2-b4dc-6f57b43ecfe8 => generated 1567 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:05:29.396498 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [req-d28091fa-455d-4af0-b018-1cff2780ce63 req-675a611d-66a6-43c6-af5e-688800fd7572 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029651 Jun 16 23:05:29.397085 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 336/663] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 23:05:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 23:05:29.494661 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-91311a07-608d-4573-9152-c79d74471f1d tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:05:29.495776 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-91311a07-608d-4573-9152-c79d74471f1d tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] [instance: 8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:05:29.502554 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-91311a07-608d-4573-9152-c79d74471f1d tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:29.503154 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-91311a07-608d-4573-9152-c79d74471f1d tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:29.504003 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-91311a07-608d-4573-9152-c79d74471f1d tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:29.504506 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-91311a07-608d-4573-9152-c79d74471f1d tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:29.569141 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-91311a07-608d-4573-9152-c79d74471f1d tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '243e592fbf1844d89f55dd5035a684f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60447df5461141e883d207e028b74bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:05:29.577632 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-91311a07-608d-4573-9152-c79d74471f1d tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] 10.222.0.17 "GET /compute/v2.1/servers/8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8" status: 200 len: 1622 microversion: 2.1 time: 0.086831 Jun 16 23:05:29.578330 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 328/664] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:05:29 2022] GET /compute/v2.1/servers/8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8 => generated 1622 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:05:30.410987 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-a350c66d-9956-4a75-a607-1fd29067a4f7 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:05:30.412291 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-a350c66d-9956-4a75-a607-1fd29067a4f7 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] [instance: aa81794d-bc81-49d2-b4dc-6f57b43ecfe8] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:05:30.418429 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-a350c66d-9956-4a75-a607-1fd29067a4f7 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:30.418914 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-a350c66d-9956-4a75-a607-1fd29067a4f7 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:30.419674 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-a350c66d-9956-4a75-a607-1fd29067a4f7 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:30.420114 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-a350c66d-9956-4a75-a607-1fd29067a4f7 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:30.551923 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-a350c66d-9956-4a75-a607-1fd29067a4f7 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01dd0e5661f44d05a01d7a5e82dbadf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b30b90ec4d5e45468a4fa0fb98e46393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:05:30.559375 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-a350c66d-9956-4a75-a607-1fd29067a4f7 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] 10.222.0.17 "GET /compute/v2.1/servers/aa81794d-bc81-49d2-b4dc-6f57b43ecfe8" status: 200 len: 1567 microversion: 2.1 time: 0.153206 Jun 16 23:05:30.559928 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 337/665] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:05:30 2022] GET /compute/v2.1/servers/aa81794d-bc81-49d2-b4dc-6f57b43ecfe8 => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:05:30.594638 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-a20191e8-cf02-42a7-9e55-b28cfe88d81a tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:05:30.595251 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-a20191e8-cf02-42a7-9e55-b28cfe88d81a tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] [instance: 8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:05:30.602298 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-a20191e8-cf02-42a7-9e55-b28cfe88d81a tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:30.602778 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-a20191e8-cf02-42a7-9e55-b28cfe88d81a tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:30.603556 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-a20191e8-cf02-42a7-9e55-b28cfe88d81a tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:30.603998 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-a20191e8-cf02-42a7-9e55-b28cfe88d81a tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:30.664080 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-a20191e8-cf02-42a7-9e55-b28cfe88d81a tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '243e592fbf1844d89f55dd5035a684f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60447df5461141e883d207e028b74bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:05:30.671398 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-a20191e8-cf02-42a7-9e55-b28cfe88d81a tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] 10.222.0.17 "GET /compute/v2.1/servers/8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8" status: 200 len: 1330 microversion: 2.1 time: 0.080617 Jun 16 23:05:30.671953 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 329/666] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:05:30 2022] GET /compute/v2.1/servers/8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8 => generated 1330 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:05:31.575667 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-eeb98de3-ec74-4750-a844-0f3ca343fccd tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:05:31.576222 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-eeb98de3-ec74-4750-a844-0f3ca343fccd tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] [instance: aa81794d-bc81-49d2-b4dc-6f57b43ecfe8] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:05:31.582623 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-eeb98de3-ec74-4750-a844-0f3ca343fccd tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:31.583081 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-eeb98de3-ec74-4750-a844-0f3ca343fccd tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:31.583860 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-eeb98de3-ec74-4750-a844-0f3ca343fccd tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:31.584295 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-eeb98de3-ec74-4750-a844-0f3ca343fccd tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:31.687271 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-8ff90e82-dc1d-4300-b05b-51577ea4ec76 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:05:31.687878 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-8ff90e82-dc1d-4300-b05b-51577ea4ec76 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] [instance: 8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:05:31.694365 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-8ff90e82-dc1d-4300-b05b-51577ea4ec76 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:31.694861 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-8ff90e82-dc1d-4300-b05b-51577ea4ec76 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:31.695632 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-8ff90e82-dc1d-4300-b05b-51577ea4ec76 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:31.696076 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-8ff90e82-dc1d-4300-b05b-51577ea4ec76 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:31.712517 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-eeb98de3-ec74-4750-a844-0f3ca343fccd tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01dd0e5661f44d05a01d7a5e82dbadf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b30b90ec4d5e45468a4fa0fb98e46393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:05:31.719931 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-eeb98de3-ec74-4750-a844-0f3ca343fccd tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] 10.222.0.17 "GET /compute/v2.1/servers/aa81794d-bc81-49d2-b4dc-6f57b43ecfe8" status: 200 len: 1567 microversion: 2.1 time: 0.148174 Jun 16 23:05:31.720490 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 338/667] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:05:31 2022] GET /compute/v2.1/servers/aa81794d-bc81-49d2-b4dc-6f57b43ecfe8 => generated 1567 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:05:31.759897 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-8ff90e82-dc1d-4300-b05b-51577ea4ec76 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '243e592fbf1844d89f55dd5035a684f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60447df5461141e883d207e028b74bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:05:31.767502 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-8ff90e82-dc1d-4300-b05b-51577ea4ec76 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] 10.222.0.17 "GET /compute/v2.1/servers/8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8" status: 200 len: 1330 microversion: 2.1 time: 0.084075 Jun 16 23:05:31.768054 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 330/668] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:05:31 2022] GET /compute/v2.1/servers/8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8 => generated 1330 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 23:05:32.737297 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-e7b37c48-bb97-4425-aa4b-205316bff3ac tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:05:32.737836 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-e7b37c48-bb97-4425-aa4b-205316bff3ac tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] [instance: aa81794d-bc81-49d2-b4dc-6f57b43ecfe8] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:05:32.744788 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-e7b37c48-bb97-4425-aa4b-205316bff3ac tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:32.745242 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-e7b37c48-bb97-4425-aa4b-205316bff3ac tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:32.746008 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-e7b37c48-bb97-4425-aa4b-205316bff3ac tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:32.746446 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-e7b37c48-bb97-4425-aa4b-205316bff3ac tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:32.784298 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-34630cd7-2c22-4ae7-b0b5-de6296d5942a tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:05:32.785559 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-34630cd7-2c22-4ae7-b0b5-de6296d5942a tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] [instance: 8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:05:32.792129 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-34630cd7-2c22-4ae7-b0b5-de6296d5942a tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:32.792580 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-34630cd7-2c22-4ae7-b0b5-de6296d5942a tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:32.793386 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-34630cd7-2c22-4ae7-b0b5-de6296d5942a tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:32.793825 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-34630cd7-2c22-4ae7-b0b5-de6296d5942a tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:32.808317 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.wsgi [None req-34630cd7-2c22-4ae7-b0b5-de6296d5942a tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] HTTP exception thrown: Instance 8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8 could not be found. Jun 16 23:05:32.811212 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-34630cd7-2c22-4ae7-b0b5-de6296d5942a tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Request method failure captured: Jun 16 23:05:32.811212 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: request: GET /compute/v2.1/servers/8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8 HTTP/1.1 Jun 16 23:05:32.811212 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Accept: application/json Jun 16 23:05:32.811212 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Accept-Encoding: identity Jun 16 23:05:32.811212 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Connection: close Jun 16 23:05:32.811212 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Content-Length: 0 Jun 16 23:05:32.811212 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Content-Type: application/json Jun 16 23:05:32.811212 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Host: 10.222.0.17 Jun 16 23:05:32.811212 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Openstack-System-Scope: None Jun 16 23:05:32.811212 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: User-Agent: python-urllib3/1.26.9 Jun 16 23:05:32.811212 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Auth-Token: gAAAAABiq7Ybpb0QO0FcFn_EOw5P6FTbOHo1mCVh1QS4wC871UGlRsfydiFbvefR_ouEKZbaz8Cp87VYbn--bsc0A8Z56HhTuujXXbcpoO2sA3ojRA0C8Q-lwRF3sq-FBCCjaN6ItRbHJC1L8ezexrcUPCnREK8HUDeFj-L4igPJ9X0jeAiI_Ic Jun 16 23:05:32.811212 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Domain-Id: None Jun 16 23:05:32.811212 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Domain-Name: None Jun 16 23:05:32.811212 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Identity-Status: Confirmed Jun 16 23:05:32.811212 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Is-Admin-Project: True Jun 16 23:05:32.811212 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Project-Domain-Id: default Jun 16 23:05:32.811212 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Project-Domain-Name: Default Jun 16 23:05:32.811212 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Project-Id: 60447df5461141e883d207e028b74bc7 Jun 16 23:05:32.811212 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1782574210 Jun 16 23:05:32.811212 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Role: member,reader Jun 16 23:05:32.811212 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Roles: member,reader Jun 16 23:05:32.812615 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/60447df5461141e883d207e028b74bc7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_60447df5461141e883d207e028b74bc7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/60447df5461141e883d207e028b74bc7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/60447df5461141e883d207e028b74bc7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Jun 16 23:05:32.812615 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1782574210 Jun 16 23:05:32.812615 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Tenant-Id: 60447df5461141e883d207e028b74bc7 Jun 16 23:05:32.812615 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1782574210 Jun 16 23:05:32.812615 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-User: tempest-ServerRescueNegativeTestJSON-1782574210-project Jun 16 23:05:32.812615 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-User-Domain-Id: default Jun 16 23:05:32.812615 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-User-Domain-Name: Default Jun 16 23:05:32.812615 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-User-Id: 243e592fbf1844d89f55dd5035a684f3 Jun 16 23:05:32.812615 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1782574210-project Jun 16 23:05:32.812615 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: method: > Jun 16 23:05:32.812615 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: exception: Instance 8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8 could not be found. Jun 16 23:05:32.812615 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: action_args: {'id': '8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8'} Jun 16 23:05:32.813352 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 23:05:32.813352 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 23:05:32.813352 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 23:05:32.813352 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 23:05:32.813352 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 23:05:32.813352 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 23:05:32.813352 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 23:05:32.813352 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 23:05:32.813352 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 23:05:32.813352 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 23:05:32.813352 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8 could not be found. Jun 16 23:05:32.813352 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 16 23:05:32.813352 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 23:05:32.813352 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 16 23:05:32.813352 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 23:05:32.813352 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 23:05:32.813352 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 23:05:32.813352 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 23:05:32.813352 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 23:05:32.813352 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 23:05:32.814546 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 23:05:32.814546 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 23:05:32.814546 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 23:05:32.814546 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 23:05:32.814546 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 23:05:32.814546 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 23:05:32.814546 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 23:05:32.814546 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8 could not be found. Jun 16 23:05:32.814546 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 16 23:05:32.814546 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 23:05:32.814546 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 16 23:05:32.814546 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 23:05:32.814546 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 23:05:32.814546 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 23:05:32.814546 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 23:05:32.814546 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 23:05:32.814546 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8 could not be found. Jun 16 23:05:32.814546 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 16 23:05:32.817184 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-34630cd7-2c22-4ae7-b0b5-de6296d5942a tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Returning 404 to user: Instance 8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8 could not be found. {{(pid=117563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 23:05:32.817184 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-34630cd7-2c22-4ae7-b0b5-de6296d5942a tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] 10.222.0.17 "GET /compute/v2.1/servers/8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8" status: 404 len: 111 microversion: 2.1 time: 0.032197 Jun 16 23:05:32.817184 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 331/669] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:05:32 2022] GET /compute/v2.1/servers/8e0a5e0b-57cd-45b2-9b36-ea3b89e305d8 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 23:05:32.822056 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-c5b298e2-4c87-4b9e-820f-e2af5d5036c5 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Calling method '.version_select at 0x7f53135f8670>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:05:32.840142 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-c5b298e2-4c87-4b9e-820f-e2af5d5036c5 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1200536764" status: 202 len: 0 microversion: 2.1 time: 0.022172 Jun 16 23:05:32.840715 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 332/670] 10.222.0.17 () {58 vars in 1220 bytes} [Thu Jun 16 23:05:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1200536764 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 16 23:05:32.879115 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-e7b37c48-bb97-4425-aa4b-205316bff3ac tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01dd0e5661f44d05a01d7a5e82dbadf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b30b90ec4d5e45468a4fa0fb98e46393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:05:32.886543 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-e7b37c48-bb97-4425-aa4b-205316bff3ac tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] 10.222.0.17 "GET /compute/v2.1/servers/aa81794d-bc81-49d2-b4dc-6f57b43ecfe8" status: 200 len: 1567 microversion: 2.1 time: 0.153209 Jun 16 23:05:32.890909 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 339/671] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:05:32 2022] GET /compute/v2.1/servers/aa81794d-bc81-49d2-b4dc-6f57b43ecfe8 => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:05:33.115646 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-0bcc4625-3d1a-4880-9512-f549bb845a18 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:05:33.116611 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-0bcc4625-3d1a-4880-9512-f549bb845a18 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] [instance: f4c73822-1dfa-4eed-bf02-1123b0402755] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:05:33.123283 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-0bcc4625-3d1a-4880-9512-f549bb845a18 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:33.123743 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-0bcc4625-3d1a-4880-9512-f549bb845a18 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:33.124519 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-0bcc4625-3d1a-4880-9512-f549bb845a18 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:33.124961 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-0bcc4625-3d1a-4880-9512-f549bb845a18 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:33.129521 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG dbcounter [-] [117563] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 23:05:33.157137 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-0bcc4625-3d1a-4880-9512-f549bb845a18 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] 10.222.0.17 "GET /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046619 Jun 16 23:05:33.158019 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 333/672] 10.222.0.17 () {58 vars in 1301 bytes} [Thu Jun 16 23:05:33 2022] GET /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 23:05:33.227564 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-4968cd51-a6b0-4dd5-8cca-3815e2973952 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:05:33.228272 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-4968cd51-a6b0-4dd5-8cca-3815e2973952 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] [instance: f4c73822-1dfa-4eed-bf02-1123b0402755] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:05:33.234609 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-4968cd51-a6b0-4dd5-8cca-3815e2973952 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:33.235137 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-4968cd51-a6b0-4dd5-8cca-3815e2973952 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:33.236961 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-4968cd51-a6b0-4dd5-8cca-3815e2973952 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:33.237728 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-4968cd51-a6b0-4dd5-8cca-3815e2973952 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:33.266864 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-4968cd51-a6b0-4dd5-8cca-3815e2973952 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] [instance: f4c73822-1dfa-4eed-bf02-1123b0402755] Going to try to terminate instance {{(pid=117562) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 23:05:33.366484 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-4968cd51-a6b0-4dd5-8cca-3815e2973952 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] 10.222.0.17 "DELETE /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755" status: 204 len: 0 microversion: 2.1 time: 0.142713 Jun 16 23:05:33.367325 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 340/673] 10.222.0.17 () {58 vars in 1238 bytes} [Thu Jun 16 23:05:33 2022] DELETE /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 23:05:33.377961 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-585ab8ed-0d17-48b2-b871-4bf020c8fdaa tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:05:33.379168 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-585ab8ed-0d17-48b2-b871-4bf020c8fdaa tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] [instance: f4c73822-1dfa-4eed-bf02-1123b0402755] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:05:33.390318 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-585ab8ed-0d17-48b2-b871-4bf020c8fdaa tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:33.390999 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-585ab8ed-0d17-48b2-b871-4bf020c8fdaa tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:33.392596 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-585ab8ed-0d17-48b2-b871-4bf020c8fdaa tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:33.393051 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-585ab8ed-0d17-48b2-b871-4bf020c8fdaa tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:33.651862 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-585ab8ed-0d17-48b2-b871-4bf020c8fdaa tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a993f5d14b64fccad723abecfcadf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b1be8431b0434d8bd6abca293127d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:05:33.659777 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-585ab8ed-0d17-48b2-b871-4bf020c8fdaa tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] 10.222.0.17 "GET /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755" status: 200 len: 1673 microversion: 2.1 time: 0.288061 Jun 16 23:05:33.660447 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 334/674] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:05:33 2022] GET /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755 => generated 1673 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:05:33.903919 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-8a9f434a-c4aa-47e3-9090-f0121f790c2f tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:05:33.904617 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-8a9f434a-c4aa-47e3-9090-f0121f790c2f tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] [instance: aa81794d-bc81-49d2-b4dc-6f57b43ecfe8] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:05:33.911115 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-8a9f434a-c4aa-47e3-9090-f0121f790c2f tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:33.911544 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-8a9f434a-c4aa-47e3-9090-f0121f790c2f tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:33.912800 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-8a9f434a-c4aa-47e3-9090-f0121f790c2f tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:33.913244 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-8a9f434a-c4aa-47e3-9090-f0121f790c2f tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:34.046211 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-8a9f434a-c4aa-47e3-9090-f0121f790c2f tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01dd0e5661f44d05a01d7a5e82dbadf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b30b90ec4d5e45468a4fa0fb98e46393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:05:34.057676 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-8a9f434a-c4aa-47e3-9090-f0121f790c2f tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] 10.222.0.17 "GET /compute/v2.1/servers/aa81794d-bc81-49d2-b4dc-6f57b43ecfe8" status: 200 len: 1567 microversion: 2.1 time: 0.157645 Jun 16 23:05:34.058582 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 341/675] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:05:33 2022] GET /compute/v2.1/servers/aa81794d-bc81-49d2-b4dc-6f57b43ecfe8 => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:05:34.677184 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-c78174fd-41b4-4171-8cfc-dac4b0700a9b tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:05:34.677791 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-c78174fd-41b4-4171-8cfc-dac4b0700a9b tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] [instance: f4c73822-1dfa-4eed-bf02-1123b0402755] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:05:34.683966 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-c78174fd-41b4-4171-8cfc-dac4b0700a9b tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:34.684417 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-c78174fd-41b4-4171-8cfc-dac4b0700a9b tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:34.685176 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-c78174fd-41b4-4171-8cfc-dac4b0700a9b tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:34.685622 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-c78174fd-41b4-4171-8cfc-dac4b0700a9b tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:34.811321 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-c78174fd-41b4-4171-8cfc-dac4b0700a9b tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a993f5d14b64fccad723abecfcadf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b1be8431b0434d8bd6abca293127d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:05:34.820178 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-c78174fd-41b4-4171-8cfc-dac4b0700a9b tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] 10.222.0.17 "GET /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755" status: 200 len: 1673 microversion: 2.1 time: 0.146754 Jun 16 23:05:34.820966 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 335/676] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:05:34 2022] GET /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755 => generated 1673 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 23:05:35.080482 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-d34ff45e-5fc4-4052-94a2-b7acac91aacf tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:05:35.081492 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-d34ff45e-5fc4-4052-94a2-b7acac91aacf tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] [instance: aa81794d-bc81-49d2-b4dc-6f57b43ecfe8] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:05:35.089419 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-d34ff45e-5fc4-4052-94a2-b7acac91aacf tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:35.089867 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-d34ff45e-5fc4-4052-94a2-b7acac91aacf tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:35.090653 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-d34ff45e-5fc4-4052-94a2-b7acac91aacf tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:35.091095 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-d34ff45e-5fc4-4052-94a2-b7acac91aacf tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:35.221921 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-d34ff45e-5fc4-4052-94a2-b7acac91aacf tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01dd0e5661f44d05a01d7a5e82dbadf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b30b90ec4d5e45468a4fa0fb98e46393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:05:35.229909 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-d34ff45e-5fc4-4052-94a2-b7acac91aacf tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] 10.222.0.17 "GET /compute/v2.1/servers/aa81794d-bc81-49d2-b4dc-6f57b43ecfe8" status: 200 len: 1567 microversion: 2.1 time: 0.156246 Jun 16 23:05:35.230477 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 342/677] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:05:35 2022] GET /compute/v2.1/servers/aa81794d-bc81-49d2-b4dc-6f57b43ecfe8 => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:05:35.837390 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-9b3c6564-a98c-4493-9f98-8f17b190c08e tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:05:35.838003 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-9b3c6564-a98c-4493-9f98-8f17b190c08e tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] [instance: f4c73822-1dfa-4eed-bf02-1123b0402755] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:05:35.844481 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-9b3c6564-a98c-4493-9f98-8f17b190c08e tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:35.844924 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-9b3c6564-a98c-4493-9f98-8f17b190c08e tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:35.845682 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-9b3c6564-a98c-4493-9f98-8f17b190c08e tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:35.846148 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-9b3c6564-a98c-4493-9f98-8f17b190c08e tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:35.973124 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-9b3c6564-a98c-4493-9f98-8f17b190c08e tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a993f5d14b64fccad723abecfcadf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b1be8431b0434d8bd6abca293127d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:05:35.980964 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-9b3c6564-a98c-4493-9f98-8f17b190c08e tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] 10.222.0.17 "GET /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755" status: 200 len: 1673 microversion: 2.1 time: 0.147689 Jun 16 23:05:35.981746 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 336/678] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:05:35 2022] GET /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755 => generated 1673 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:05:36.246586 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-f4e50d6b-a191-480d-84a7-e99909410fbd tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:05:36.247216 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-f4e50d6b-a191-480d-84a7-e99909410fbd tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] [instance: aa81794d-bc81-49d2-b4dc-6f57b43ecfe8] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:05:36.253799 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-f4e50d6b-a191-480d-84a7-e99909410fbd tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:36.254246 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-f4e50d6b-a191-480d-84a7-e99909410fbd tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:36.255043 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-f4e50d6b-a191-480d-84a7-e99909410fbd tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:36.255487 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-f4e50d6b-a191-480d-84a7-e99909410fbd tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:36.384741 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-f4e50d6b-a191-480d-84a7-e99909410fbd tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01dd0e5661f44d05a01d7a5e82dbadf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b30b90ec4d5e45468a4fa0fb98e46393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:05:36.392166 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-f4e50d6b-a191-480d-84a7-e99909410fbd tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] 10.222.0.17 "GET /compute/v2.1/servers/aa81794d-bc81-49d2-b4dc-6f57b43ecfe8" status: 200 len: 1567 microversion: 2.1 time: 0.149479 Jun 16 23:05:36.392729 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 343/679] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:05:36 2022] GET /compute/v2.1/servers/aa81794d-bc81-49d2-b4dc-6f57b43ecfe8 => generated 1567 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:05:36.998328 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-91ce91ae-3811-4e91-a9c6-de10eef42202 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:05:36.999041 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-91ce91ae-3811-4e91-a9c6-de10eef42202 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] [instance: f4c73822-1dfa-4eed-bf02-1123b0402755] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:05:37.005383 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-91ce91ae-3811-4e91-a9c6-de10eef42202 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:37.006372 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-91ce91ae-3811-4e91-a9c6-de10eef42202 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:37.007154 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-91ce91ae-3811-4e91-a9c6-de10eef42202 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:37.007588 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-91ce91ae-3811-4e91-a9c6-de10eef42202 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:37.136414 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-91ce91ae-3811-4e91-a9c6-de10eef42202 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a993f5d14b64fccad723abecfcadf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b1be8431b0434d8bd6abca293127d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:05:37.143978 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-91ce91ae-3811-4e91-a9c6-de10eef42202 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] 10.222.0.17 "GET /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755" status: 200 len: 1673 microversion: 2.1 time: 0.149415 Jun 16 23:05:37.144540 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 337/680] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:05:36 2022] GET /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755 => generated 1673 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:05:37.409167 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-7646d7fa-538e-4c1a-a713-f58735a6679c tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:05:37.409831 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-7646d7fa-538e-4c1a-a713-f58735a6679c tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] [instance: aa81794d-bc81-49d2-b4dc-6f57b43ecfe8] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:05:37.416258 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-7646d7fa-538e-4c1a-a713-f58735a6679c tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:37.416710 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-7646d7fa-538e-4c1a-a713-f58735a6679c tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:37.417471 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-7646d7fa-538e-4c1a-a713-f58735a6679c tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:37.417910 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-7646d7fa-538e-4c1a-a713-f58735a6679c tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:37.551695 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-7646d7fa-538e-4c1a-a713-f58735a6679c tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01dd0e5661f44d05a01d7a5e82dbadf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b30b90ec4d5e45468a4fa0fb98e46393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:05:37.554216 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG dbcounter [-] [117562] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 23:05:37.561407 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-7646d7fa-538e-4c1a-a713-f58735a6679c tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] 10.222.0.17 "GET /compute/v2.1/servers/aa81794d-bc81-49d2-b4dc-6f57b43ecfe8" status: 200 len: 1567 microversion: 2.1 time: 0.156124 Jun 16 23:05:37.562144 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 344/681] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:05:37 2022] GET /compute/v2.1/servers/aa81794d-bc81-49d2-b4dc-6f57b43ecfe8 => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:05:38.009190 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-7070ebfc-4f65-448f-8867-f8b598978175 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:05:38.009864 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-7070ebfc-4f65-448f-8867-f8b598978175 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] [instance: c2b8ba99-d845-4fca-b9e7-fc77ac91a601] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:05:38.016670 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-7070ebfc-4f65-448f-8867-f8b598978175 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:38.017197 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-7070ebfc-4f65-448f-8867-f8b598978175 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:38.018057 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-7070ebfc-4f65-448f-8867-f8b598978175 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:38.018569 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-7070ebfc-4f65-448f-8867-f8b598978175 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:38.044475 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-7070ebfc-4f65-448f-8867-f8b598978175 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] [instance: c2b8ba99-d845-4fca-b9e7-fc77ac91a601] Going to try to terminate instance {{(pid=117563) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 23:05:38.150019 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-7070ebfc-4f65-448f-8867-f8b598978175 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] 10.222.0.17 "DELETE /compute/v2.1/servers/c2b8ba99-d845-4fca-b9e7-fc77ac91a601" status: 204 len: 0 microversion: 2.1 time: 0.145059 Jun 16 23:05:38.150768 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 338/682] 10.222.0.17 () {58 vars in 1238 bytes} [Thu Jun 16 23:05:38 2022] DELETE /compute/v2.1/servers/c2b8ba99-d845-4fca-b9e7-fc77ac91a601 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 23:05:38.160379 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-b3257e2b-e23d-4107-94cb-95c52be57d29 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:05:38.161035 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-b3257e2b-e23d-4107-94cb-95c52be57d29 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] [instance: c2b8ba99-d845-4fca-b9e7-fc77ac91a601] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:05:38.165603 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-7404c246-16cf-40cf-b4ca-551b4a20d134 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:05:38.167482 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-7404c246-16cf-40cf-b4ca-551b4a20d134 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] [instance: f4c73822-1dfa-4eed-bf02-1123b0402755] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:05:38.167992 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-b3257e2b-e23d-4107-94cb-95c52be57d29 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:38.168450 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-b3257e2b-e23d-4107-94cb-95c52be57d29 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:38.169223 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-b3257e2b-e23d-4107-94cb-95c52be57d29 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:38.169666 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-b3257e2b-e23d-4107-94cb-95c52be57d29 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:38.185168 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-7404c246-16cf-40cf-b4ca-551b4a20d134 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:38.186401 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-7404c246-16cf-40cf-b4ca-551b4a20d134 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:38.188458 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-7404c246-16cf-40cf-b4ca-551b4a20d134 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:38.189847 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-7404c246-16cf-40cf-b4ca-551b4a20d134 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:38.406080 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-b3257e2b-e23d-4107-94cb-95c52be57d29 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '243e592fbf1844d89f55dd5035a684f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60447df5461141e883d207e028b74bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:05:38.413063 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-7404c246-16cf-40cf-b4ca-551b4a20d134 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a993f5d14b64fccad723abecfcadf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b1be8431b0434d8bd6abca293127d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:05:38.416501 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-b3257e2b-e23d-4107-94cb-95c52be57d29 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] 10.222.0.17 "GET /compute/v2.1/servers/c2b8ba99-d845-4fca-b9e7-fc77ac91a601" status: 200 len: 1508 microversion: 2.1 time: 0.261669 Jun 16 23:05:38.417194 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 345/683] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:05:38 2022] GET /compute/v2.1/servers/c2b8ba99-d845-4fca-b9e7-fc77ac91a601 => generated 1508 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:05:38.420608 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-7404c246-16cf-40cf-b4ca-551b4a20d134 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] 10.222.0.17 "GET /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755" status: 200 len: 1673 microversion: 2.1 time: 0.262947 Jun 16 23:05:38.421190 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 339/684] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:05:38 2022] GET /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755 => generated 1673 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:05:38.579002 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-cd2481d0-dd58-479d-b5ee-f96420b9027b tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:05:38.579610 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-cd2481d0-dd58-479d-b5ee-f96420b9027b tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] [instance: aa81794d-bc81-49d2-b4dc-6f57b43ecfe8] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:05:38.585938 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-cd2481d0-dd58-479d-b5ee-f96420b9027b tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:38.586417 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-cd2481d0-dd58-479d-b5ee-f96420b9027b tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:38.587212 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-cd2481d0-dd58-479d-b5ee-f96420b9027b tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:38.587650 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-cd2481d0-dd58-479d-b5ee-f96420b9027b tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:38.717364 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-cd2481d0-dd58-479d-b5ee-f96420b9027b tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01dd0e5661f44d05a01d7a5e82dbadf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b30b90ec4d5e45468a4fa0fb98e46393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:05:38.724806 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-cd2481d0-dd58-479d-b5ee-f96420b9027b tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] 10.222.0.17 "GET /compute/v2.1/servers/aa81794d-bc81-49d2-b4dc-6f57b43ecfe8" status: 200 len: 1567 microversion: 2.1 time: 0.149617 Jun 16 23:05:38.725367 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 346/685] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:05:38 2022] GET /compute/v2.1/servers/aa81794d-bc81-49d2-b4dc-6f57b43ecfe8 => generated 1567 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:05:39.434451 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-f8d866dc-e761-4dfd-9576-0041b79b36f6 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:05:39.435172 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-f8d866dc-e761-4dfd-9576-0041b79b36f6 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] [instance: c2b8ba99-d845-4fca-b9e7-fc77ac91a601] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:05:39.438210 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-f4e8b2b4-9e5c-499d-948d-59ac5f269ee3 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:05:39.438853 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-f4e8b2b4-9e5c-499d-948d-59ac5f269ee3 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] [instance: f4c73822-1dfa-4eed-bf02-1123b0402755] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:05:39.445095 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-f8d866dc-e761-4dfd-9576-0041b79b36f6 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:39.445684 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-f8d866dc-e761-4dfd-9576-0041b79b36f6 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:39.445956 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-f4e8b2b4-9e5c-499d-948d-59ac5f269ee3 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:39.446314 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-f8d866dc-e761-4dfd-9576-0041b79b36f6 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:39.446437 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-f4e8b2b4-9e5c-499d-948d-59ac5f269ee3 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:39.447180 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-f8d866dc-e761-4dfd-9576-0041b79b36f6 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:39.447296 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-f4e8b2b4-9e5c-499d-948d-59ac5f269ee3 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:39.447647 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-f4e8b2b4-9e5c-499d-948d-59ac5f269ee3 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:39.646808 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-f8d866dc-e761-4dfd-9576-0041b79b36f6 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '243e592fbf1844d89f55dd5035a684f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60447df5461141e883d207e028b74bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:05:39.650082 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-f4e8b2b4-9e5c-499d-948d-59ac5f269ee3 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a993f5d14b64fccad723abecfcadf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b1be8431b0434d8bd6abca293127d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:05:39.654165 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-f8d866dc-e761-4dfd-9576-0041b79b36f6 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] 10.222.0.17 "GET /compute/v2.1/servers/c2b8ba99-d845-4fca-b9e7-fc77ac91a601" status: 200 len: 1508 microversion: 2.1 time: 0.223704 Jun 16 23:05:39.654840 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 340/686] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:05:39 2022] GET /compute/v2.1/servers/c2b8ba99-d845-4fca-b9e7-fc77ac91a601 => generated 1508 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:05:39.657512 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-f4e8b2b4-9e5c-499d-948d-59ac5f269ee3 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] 10.222.0.17 "GET /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755" status: 200 len: 1673 microversion: 2.1 time: 0.223045 Jun 16 23:05:39.658065 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 347/687] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:05:39 2022] GET /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755 => generated 1673 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 23:05:39.741636 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-86e5e6d2-aef6-485b-9e24-02b7e6afb5eb tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:05:39.742230 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-86e5e6d2-aef6-485b-9e24-02b7e6afb5eb tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] [instance: aa81794d-bc81-49d2-b4dc-6f57b43ecfe8] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:05:39.748055 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-86e5e6d2-aef6-485b-9e24-02b7e6afb5eb tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:39.748499 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-86e5e6d2-aef6-485b-9e24-02b7e6afb5eb tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:39.749252 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-86e5e6d2-aef6-485b-9e24-02b7e6afb5eb tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:39.749762 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-86e5e6d2-aef6-485b-9e24-02b7e6afb5eb tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:39.876452 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-86e5e6d2-aef6-485b-9e24-02b7e6afb5eb tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01dd0e5661f44d05a01d7a5e82dbadf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b30b90ec4d5e45468a4fa0fb98e46393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:05:39.883861 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-86e5e6d2-aef6-485b-9e24-02b7e6afb5eb tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] 10.222.0.17 "GET /compute/v2.1/servers/aa81794d-bc81-49d2-b4dc-6f57b43ecfe8" status: 200 len: 1567 microversion: 2.1 time: 0.146576 Jun 16 23:05:39.884412 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 341/688] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:05:39 2022] GET /compute/v2.1/servers/aa81794d-bc81-49d2-b4dc-6f57b43ecfe8 => generated 1567 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 23:05:40.674206 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-d2af1515-907d-4795-81a9-0e988fe06268 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:05:40.675749 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-c7b04085-a0a1-4aed-9237-ec77b9e694bf tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:05:40.676169 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-d2af1515-907d-4795-81a9-0e988fe06268 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] [instance: c2b8ba99-d845-4fca-b9e7-fc77ac91a601] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:05:40.678119 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-c7b04085-a0a1-4aed-9237-ec77b9e694bf tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] [instance: f4c73822-1dfa-4eed-bf02-1123b0402755] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:05:40.684806 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-c7b04085-a0a1-4aed-9237-ec77b9e694bf tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:40.685514 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-c7b04085-a0a1-4aed-9237-ec77b9e694bf tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:40.686068 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-d2af1515-907d-4795-81a9-0e988fe06268 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:40.686606 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-d2af1515-907d-4795-81a9-0e988fe06268 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:40.686967 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-c7b04085-a0a1-4aed-9237-ec77b9e694bf tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:40.687565 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-d2af1515-907d-4795-81a9-0e988fe06268 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:40.687944 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-c7b04085-a0a1-4aed-9237-ec77b9e694bf tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:40.688130 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-d2af1515-907d-4795-81a9-0e988fe06268 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:40.804934 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-c7b04085-a0a1-4aed-9237-ec77b9e694bf tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a993f5d14b64fccad723abecfcadf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b1be8431b0434d8bd6abca293127d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:05:40.819876 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-c7b04085-a0a1-4aed-9237-ec77b9e694bf tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] 10.222.0.17 "GET /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755" status: 200 len: 1605 microversion: 2.1 time: 0.148279 Jun 16 23:05:40.820799 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 342/689] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:05:40 2022] GET /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755 => generated 1605 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 23:05:40.900864 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-fc665ad5-e524-4826-a764-84851b02607f tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:05:40.901471 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-fc665ad5-e524-4826-a764-84851b02607f tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] [instance: aa81794d-bc81-49d2-b4dc-6f57b43ecfe8] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:05:40.909949 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-fc665ad5-e524-4826-a764-84851b02607f tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:40.910398 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-fc665ad5-e524-4826-a764-84851b02607f tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:40.911197 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-fc665ad5-e524-4826-a764-84851b02607f tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:40.911688 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-fc665ad5-e524-4826-a764-84851b02607f tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:41.238266 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-fc665ad5-e524-4826-a764-84851b02607f tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01dd0e5661f44d05a01d7a5e82dbadf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b30b90ec4d5e45468a4fa0fb98e46393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:05:41.251594 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-fc665ad5-e524-4826-a764-84851b02607f tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] 10.222.0.17 "GET /compute/v2.1/servers/aa81794d-bc81-49d2-b4dc-6f57b43ecfe8" status: 200 len: 1568 microversion: 2.1 time: 0.354401 Jun 16 23:05:41.252129 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 343/690] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:05:40 2022] GET /compute/v2.1/servers/aa81794d-bc81-49d2-b4dc-6f57b43ecfe8 => generated 1568 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 23:05:41.256587 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [req-af89e527-c0fc-4385-acd1-d45707ca36be req-621b61f8-20cd-4bf7-b773-6e809465c45e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4c73822-1dfa-4eed-bf02-1123b0402755", "name": "network-vif-deleted", "tag": "a7d62259-83d7-4cc4-b290-3fa8f2b03ade"}]} {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 23:05:41.270659 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-d2af1515-907d-4795-81a9-0e988fe06268 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '243e592fbf1844d89f55dd5035a684f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60447df5461141e883d207e028b74bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:05:41.278297 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-d2af1515-907d-4795-81a9-0e988fe06268 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] 10.222.0.17 "GET /compute/v2.1/servers/c2b8ba99-d845-4fca-b9e7-fc77ac91a601" status: 200 len: 1508 microversion: 2.1 time: 0.610217 Jun 16 23:05:41.282968 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 348/691] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:05:40 2022] GET /compute/v2.1/servers/c2b8ba99-d845-4fca-b9e7-fc77ac91a601 => generated 1508 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:05:41.288242 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-ba3afc6e-7704-4e0b-b72b-68b9a26bfda4 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 23:05:41.295452 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-af89e527-c0fc-4385-acd1-d45707ca36be req-621b61f8-20cd-4bf7-b773-6e809465c45e service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:41.295832 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-af89e527-c0fc-4385-acd1-d45707ca36be req-621b61f8-20cd-4bf7-b773-6e809465c45e service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:41.300209 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-ba3afc6e-7704-4e0b-b72b-68b9a26bfda4 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] [instance: aa81794d-bc81-49d2-b4dc-6f57b43ecfe8] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:05:41.322519 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.compute.server_external_events [req-af89e527-c0fc-4385-acd1-d45707ca36be req-621b61f8-20cd-4bf7-b773-6e809465c45e service nova] Creating event network-vif-deleted:a7d62259-83d7-4cc4-b290-3fa8f2b03ade for instance f4c73822-1dfa-4eed-bf02-1123b0402755 on hv-cinder-84623 Jun 16 23:05:41.324399 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-ba3afc6e-7704-4e0b-b72b-68b9a26bfda4 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:41.324853 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-ba3afc6e-7704-4e0b-b72b-68b9a26bfda4 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:41.325623 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-ba3afc6e-7704-4e0b-b72b-68b9a26bfda4 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:41.326233 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-ba3afc6e-7704-4e0b-b72b-68b9a26bfda4 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:41.348454 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [req-af89e527-c0fc-4385-acd1-d45707ca36be req-621b61f8-20cd-4bf7-b773-6e809465c45e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095109 Jun 16 23:05:41.349614 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 344/692] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 23:05:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 23:05:41.476074 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-ba3afc6e-7704-4e0b-b72b-68b9a26bfda4 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] 10.222.0.17 "POST /compute/v2.1/servers/aa81794d-bc81-49d2-b4dc-6f57b43ecfe8/action" status: 202 len: 0 microversion: 2.1 time: 0.191897 Jun 16 23:05:41.477208 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 349/693] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Jun 16 23:05:41 2022] POST /compute/v2.1/servers/aa81794d-bc81-49d2-b4dc-6f57b43ecfe8/action => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 23:05:41.487738 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-92c8519a-e45c-48a3-b4f4-c646b1191f2c tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:05:41.488793 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-92c8519a-e45c-48a3-b4f4-c646b1191f2c tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] [instance: aa81794d-bc81-49d2-b4dc-6f57b43ecfe8] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:05:41.495704 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-92c8519a-e45c-48a3-b4f4-c646b1191f2c tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:41.496385 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-92c8519a-e45c-48a3-b4f4-c646b1191f2c tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:41.497777 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-92c8519a-e45c-48a3-b4f4-c646b1191f2c tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:41.499702 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-92c8519a-e45c-48a3-b4f4-c646b1191f2c tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:41.848487 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-6590a7cb-286b-4257-b8d6-b8761b8ea2e4 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:05:41.852931 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-6590a7cb-286b-4257-b8d6-b8761b8ea2e4 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] [instance: f4c73822-1dfa-4eed-bf02-1123b0402755] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:05:41.855161 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG dbcounter [-] [117562] Writing DB stats nova_api:SELECT=80,nova_api:UPDATE=2 {{(pid=117562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 23:05:41.876081 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-6590a7cb-286b-4257-b8d6-b8761b8ea2e4 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:41.877528 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-6590a7cb-286b-4257-b8d6-b8761b8ea2e4 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:41.881560 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-6590a7cb-286b-4257-b8d6-b8761b8ea2e4 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:41.883191 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-6590a7cb-286b-4257-b8d6-b8761b8ea2e4 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:41.930153 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.wsgi [None req-6590a7cb-286b-4257-b8d6-b8761b8ea2e4 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] HTTP exception thrown: Instance f4c73822-1dfa-4eed-bf02-1123b0402755 could not be found. Jun 16 23:05:41.935309 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-6590a7cb-286b-4257-b8d6-b8761b8ea2e4 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Request method failure captured: Jun 16 23:05:41.935309 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: request: GET /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755 HTTP/1.1 Jun 16 23:05:41.935309 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Accept: application/json Jun 16 23:05:41.935309 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Accept-Encoding: identity Jun 16 23:05:41.935309 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Connection: close Jun 16 23:05:41.935309 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Content-Length: 0 Jun 16 23:05:41.935309 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Content-Type: application/json Jun 16 23:05:41.935309 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Host: 10.222.0.17 Jun 16 23:05:41.935309 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Openstack-System-Scope: None Jun 16 23:05:41.935309 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: User-Agent: python-urllib3/1.26.9 Jun 16 23:05:41.935309 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Auth-Token: gAAAAABiq7Ybkk4rah_fv4iIT3idoyxagEJSApfLNzYq7Fra8s6MuOetujUSvchI7nZZPa3uftYuuLfFRK893xYPK0M7YIPcU59Mp2UTI5ytwc6UmxRGSLxfQa_itibxYb7ELKNBXf5r_xsHXxmPbxfkW6tU28wgKVjK4ck02G_3-DW1dXLlatw Jun 16 23:05:41.935309 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Domain-Id: None Jun 16 23:05:41.935309 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Domain-Name: None Jun 16 23:05:41.935309 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Identity-Status: Confirmed Jun 16 23:05:41.935309 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Is-Admin-Project: True Jun 16 23:05:41.935309 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Project-Domain-Id: default Jun 16 23:05:41.935309 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Project-Domain-Name: Default Jun 16 23:05:41.935309 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Project-Id: f3b1be8431b0434d8bd6abca293127d5 Jun 16 23:05:41.935309 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Project-Name: tempest-AttachVolumeTestJSON-1621945621 Jun 16 23:05:41.935309 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Role: member,reader Jun 16 23:05:41.935309 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Roles: member,reader Jun 16 23:05:41.936607 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/f3b1be8431b0434d8bd6abca293127d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_f3b1be8431b0434d8bd6abca293127d5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f3b1be8431b0434d8bd6abca293127d5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f3b1be8431b0434d8bd6abca293127d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Jun 16 23:05:41.936607 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Tenant: tempest-AttachVolumeTestJSON-1621945621 Jun 16 23:05:41.936607 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Tenant-Id: f3b1be8431b0434d8bd6abca293127d5 Jun 16 23:05:41.936607 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1621945621 Jun 16 23:05:41.936607 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-User: tempest-AttachVolumeTestJSON-1621945621-project Jun 16 23:05:41.936607 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-User-Domain-Id: default Jun 16 23:05:41.936607 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-User-Domain-Name: Default Jun 16 23:05:41.936607 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-User-Id: 6a993f5d14b64fccad723abecfcadf90 Jun 16 23:05:41.936607 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-User-Name: tempest-AttachVolumeTestJSON-1621945621-project Jun 16 23:05:41.936607 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: method: > Jun 16 23:05:41.936607 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: exception: Instance f4c73822-1dfa-4eed-bf02-1123b0402755 could not be found. Jun 16 23:05:41.936607 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: action_args: {'id': 'f4c73822-1dfa-4eed-bf02-1123b0402755'} Jun 16 23:05:41.937374 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 23:05:41.937374 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 23:05:41.937374 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 23:05:41.937374 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 23:05:41.937374 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 23:05:41.937374 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 23:05:41.937374 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 23:05:41.937374 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 23:05:41.937374 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 23:05:41.937374 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 23:05:41.937374 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4c73822-1dfa-4eed-bf02-1123b0402755 could not be found. Jun 16 23:05:41.937374 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Jun 16 23:05:41.937374 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 23:05:41.937374 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Jun 16 23:05:41.937374 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 23:05:41.937374 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 23:05:41.937374 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 23:05:41.937374 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 23:05:41.937374 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 23:05:41.937374 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 23:05:41.938583 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 23:05:41.938583 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 23:05:41.938583 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 23:05:41.938583 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 23:05:41.938583 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 23:05:41.938583 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 23:05:41.938583 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 23:05:41.938583 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4c73822-1dfa-4eed-bf02-1123b0402755 could not be found. Jun 16 23:05:41.938583 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Jun 16 23:05:41.938583 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 23:05:41.938583 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Jun 16 23:05:41.938583 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 23:05:41.938583 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 23:05:41.938583 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 23:05:41.938583 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 23:05:41.938583 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 23:05:41.938583 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4c73822-1dfa-4eed-bf02-1123b0402755 could not be found. Jun 16 23:05:41.938583 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Jun 16 23:05:41.941469 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-6590a7cb-286b-4257-b8d6-b8761b8ea2e4 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Returning 404 to user: Instance f4c73822-1dfa-4eed-bf02-1123b0402755 could not be found. {{(pid=117562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 23:05:41.942636 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-6590a7cb-286b-4257-b8d6-b8761b8ea2e4 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] 10.222.0.17 "GET /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755" status: 404 len: 111 microversion: 2.1 time: 0.109030 Jun 16 23:05:41.947363 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 350/694] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:05:41 2022] GET /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755 => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 23:05:41.953129 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-bc64c9c2-1b76-42bd-979b-b7449ff808c2 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Calling method '.version_select at 0x7f5313f1ee50>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:05:41.956428 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-92c8519a-e45c-48a3-b4f4-c646b1191f2c tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01dd0e5661f44d05a01d7a5e82dbadf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b30b90ec4d5e45468a4fa0fb98e46393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:05:41.964535 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-92c8519a-e45c-48a3-b4f4-c646b1191f2c tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] 10.222.0.17 "GET /compute/v2.1/servers/aa81794d-bc81-49d2-b4dc-6f57b43ecfe8" status: 200 len: 1516 microversion: 2.1 time: 0.482898 Jun 16 23:05:41.965113 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 345/695] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:05:41 2022] GET /compute/v2.1/servers/aa81794d-bc81-49d2-b4dc-6f57b43ecfe8 => generated 1516 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:05:41.985944 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-bc64c9c2-1b76-42bd-979b-b7449ff808c2 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-869930941" status: 202 len: 0 microversion: 2.1 time: 0.037002 Jun 16 23:05:41.990925 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 351/696] 10.222.0.17 () {58 vars in 1217 bytes} [Thu Jun 16 23:05:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-869930941 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 23:05:42.298498 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-d30d8865-f6db-4425-a8f1-60a1bd3662c7 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:05:42.299429 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-d30d8865-f6db-4425-a8f1-60a1bd3662c7 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] [instance: c2b8ba99-d845-4fca-b9e7-fc77ac91a601] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:05:42.318301 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-d30d8865-f6db-4425-a8f1-60a1bd3662c7 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:42.318783 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-d30d8865-f6db-4425-a8f1-60a1bd3662c7 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:42.319565 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-d30d8865-f6db-4425-a8f1-60a1bd3662c7 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:42.320007 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-d30d8865-f6db-4425-a8f1-60a1bd3662c7 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:42.385943 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-d30d8865-f6db-4425-a8f1-60a1bd3662c7 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:42.386774 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-d30d8865-f6db-4425-a8f1-60a1bd3662c7 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:42.387540 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.objects.instance [None req-d30d8865-f6db-4425-a8f1-60a1bd3662c7 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lazy-loading 'fault' on Instance uuid c2b8ba99-d845-4fca-b9e7-fc77ac91a601 {{(pid=117563) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 23:05:42.451263 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-d30d8865-f6db-4425-a8f1-60a1bd3662c7 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '243e592fbf1844d89f55dd5035a684f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60447df5461141e883d207e028b74bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:05:42.458745 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-d30d8865-f6db-4425-a8f1-60a1bd3662c7 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] 10.222.0.17 "GET /compute/v2.1/servers/c2b8ba99-d845-4fca-b9e7-fc77ac91a601" status: 200 len: 1312 microversion: 2.1 time: 0.165601 Jun 16 23:05:42.459576 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 346/697] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:05:42 2022] GET /compute/v2.1/servers/c2b8ba99-d845-4fca-b9e7-fc77ac91a601 => generated 1312 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:05:42.910275 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-e98ba5cf-1e8f-496a-8ca0-84f96cedcfab tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Action: 'create', calling method: .version_select at 0x7f5313ddaee0>, body: {"keypair": {"name": "tempest-keypair-1672104557", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIqB90mPvXonSIIbIJDXsfInI1vq94uFN3pPIBXxLy2jvzLd4FvCMXytgJzxZdikmvXWlovmQk1SWzOTTCcKMVBi6RUsXsvEHQ1Y5kvQYJEensydWuWSgvItxRpnIHHqCw=="}} {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 23:05:42.928469 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.quota [None req-e98ba5cf-1e8f-496a-8ca0-84f96cedcfab tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Getting quotas for project f3b1be8431b0434d8bd6abca293127d5. Resources: {'key_pairs'} {{(pid=117562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 23:05:42.932341 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.quota [None req-e98ba5cf-1e8f-496a-8ca0-84f96cedcfab tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Getting quotas for user 6a993f5d14b64fccad723abecfcadf90 and project f3b1be8431b0434d8bd6abca293127d5. Resources: {'key_pairs'} {{(pid=117562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 23:05:42.955909 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-e98ba5cf-1e8f-496a-8ca0-84f96cedcfab tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.172224 Jun 16 23:05:42.956871 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 352/698] 10.222.0.17 () {60 vars in 1158 bytes} [Thu Jun 16 23:05:42 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 23:05:42.984218 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-87271b3c-ef2b-4473-925a-679236a11168 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:05:42.985731 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-87271b3c-ef2b-4473-925a-679236a11168 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] [instance: aa81794d-bc81-49d2-b4dc-6f57b43ecfe8] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:05:42.993657 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-87271b3c-ef2b-4473-925a-679236a11168 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:42.994408 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-87271b3c-ef2b-4473-925a-679236a11168 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:42.995440 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-87271b3c-ef2b-4473-925a-679236a11168 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:42.996102 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-87271b3c-ef2b-4473-925a-679236a11168 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:43.148571 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-87271b3c-ef2b-4473-925a-679236a11168 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01dd0e5661f44d05a01d7a5e82dbadf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b30b90ec4d5e45468a4fa0fb98e46393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:05:43.156883 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-87271b3c-ef2b-4473-925a-679236a11168 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] 10.222.0.17 "GET /compute/v2.1/servers/aa81794d-bc81-49d2-b4dc-6f57b43ecfe8" status: 200 len: 1574 microversion: 2.1 time: 0.179129 Jun 16 23:05:43.168009 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 347/699] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:05:42 2022] GET /compute/v2.1/servers/aa81794d-bc81-49d2-b4dc-6f57b43ecfe8 => generated 1574 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:05:43.478394 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-34612a83-386e-4119-a84a-4a69ad593f75 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:05:43.479267 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-34612a83-386e-4119-a84a-4a69ad593f75 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] [instance: c2b8ba99-d845-4fca-b9e7-fc77ac91a601] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:05:43.495159 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-34612a83-386e-4119-a84a-4a69ad593f75 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:43.495362 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [req-785bdccc-c122-44eb-a7a6-62ad33c9c420 req-186316d6-4d99-47f0-a2bd-5935b05e0038 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2b8ba99-d845-4fca-b9e7-fc77ac91a601", "name": "network-vif-deleted", "tag": "020e6819-d071-41f2-9573-ea592ee5004c"}]} {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 23:05:43.496108 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-34612a83-386e-4119-a84a-4a69ad593f75 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:43.498069 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-34612a83-386e-4119-a84a-4a69ad593f75 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:43.498868 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-34612a83-386e-4119-a84a-4a69ad593f75 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:43.513600 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG dbcounter [-] [117563] Writing DB stats nova_api:SELECT=88,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=117563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 23:05:43.522477 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-785bdccc-c122-44eb-a7a6-62ad33c9c420 req-186316d6-4d99-47f0-a2bd-5935b05e0038 service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:43.523025 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-785bdccc-c122-44eb-a7a6-62ad33c9c420 req-186316d6-4d99-47f0-a2bd-5935b05e0038 service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:43.525827 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.wsgi [None req-34612a83-386e-4119-a84a-4a69ad593f75 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] HTTP exception thrown: Instance c2b8ba99-d845-4fca-b9e7-fc77ac91a601 could not be found. Jun 16 23:05:43.529726 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-34612a83-386e-4119-a84a-4a69ad593f75 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Request method failure captured: Jun 16 23:05:43.529726 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: request: GET /compute/v2.1/servers/c2b8ba99-d845-4fca-b9e7-fc77ac91a601 HTTP/1.1 Jun 16 23:05:43.529726 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Accept: application/json Jun 16 23:05:43.529726 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Accept-Encoding: identity Jun 16 23:05:43.529726 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Connection: close Jun 16 23:05:43.529726 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Content-Length: 0 Jun 16 23:05:43.529726 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Content-Type: application/json Jun 16 23:05:43.529726 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Host: 10.222.0.17 Jun 16 23:05:43.529726 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Openstack-System-Scope: None Jun 16 23:05:43.529726 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: User-Agent: python-urllib3/1.26.9 Jun 16 23:05:43.529726 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Auth-Token: gAAAAABiq7Ybpb0QO0FcFn_EOw5P6FTbOHo1mCVh1QS4wC871UGlRsfydiFbvefR_ouEKZbaz8Cp87VYbn--bsc0A8Z56HhTuujXXbcpoO2sA3ojRA0C8Q-lwRF3sq-FBCCjaN6ItRbHJC1L8ezexrcUPCnREK8HUDeFj-L4igPJ9X0jeAiI_Ic Jun 16 23:05:43.529726 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Domain-Id: None Jun 16 23:05:43.529726 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Domain-Name: None Jun 16 23:05:43.529726 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Identity-Status: Confirmed Jun 16 23:05:43.529726 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Is-Admin-Project: True Jun 16 23:05:43.529726 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Project-Domain-Id: default Jun 16 23:05:43.529726 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Project-Domain-Name: Default Jun 16 23:05:43.529726 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Project-Id: 60447df5461141e883d207e028b74bc7 Jun 16 23:05:43.529726 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1782574210 Jun 16 23:05:43.529726 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Role: member,reader Jun 16 23:05:43.529726 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Roles: member,reader Jun 16 23:05:43.531078 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/60447df5461141e883d207e028b74bc7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_60447df5461141e883d207e028b74bc7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/60447df5461141e883d207e028b74bc7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/60447df5461141e883d207e028b74bc7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Jun 16 23:05:43.531078 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1782574210 Jun 16 23:05:43.531078 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Tenant-Id: 60447df5461141e883d207e028b74bc7 Jun 16 23:05:43.531078 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1782574210 Jun 16 23:05:43.531078 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-User: tempest-ServerRescueNegativeTestJSON-1782574210-project Jun 16 23:05:43.531078 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-User-Domain-Id: default Jun 16 23:05:43.531078 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-User-Domain-Name: Default Jun 16 23:05:43.531078 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-User-Id: 243e592fbf1844d89f55dd5035a684f3 Jun 16 23:05:43.531078 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1782574210-project Jun 16 23:05:43.531078 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: method: > Jun 16 23:05:43.531078 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: exception: Instance c2b8ba99-d845-4fca-b9e7-fc77ac91a601 could not be found. Jun 16 23:05:43.531078 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: action_args: {'id': 'c2b8ba99-d845-4fca-b9e7-fc77ac91a601'} Jun 16 23:05:43.532000 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 23:05:43.532000 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 23:05:43.532000 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 23:05:43.532000 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 23:05:43.532000 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 23:05:43.532000 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 23:05:43.532000 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 23:05:43.532000 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 23:05:43.532000 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 23:05:43.532000 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 23:05:43.532000 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c2b8ba99-d845-4fca-b9e7-fc77ac91a601 could not be found. Jun 16 23:05:43.532000 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Jun 16 23:05:43.532000 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 23:05:43.532000 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Jun 16 23:05:43.532000 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 23:05:43.532000 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 23:05:43.532000 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 23:05:43.532000 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 23:05:43.532000 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 23:05:43.532000 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 23:05:43.533152 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 23:05:43.533152 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 23:05:43.533152 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 23:05:43.533152 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 23:05:43.533152 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 23:05:43.533152 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 23:05:43.533152 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 23:05:43.533152 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c2b8ba99-d845-4fca-b9e7-fc77ac91a601 could not be found. Jun 16 23:05:43.533152 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Jun 16 23:05:43.533152 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 23:05:43.533152 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Jun 16 23:05:43.533152 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 23:05:43.533152 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 23:05:43.533152 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 23:05:43.533152 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 23:05:43.533152 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 23:05:43.533152 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c2b8ba99-d845-4fca-b9e7-fc77ac91a601 could not be found. Jun 16 23:05:43.533152 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Jun 16 23:05:43.548021 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-34612a83-386e-4119-a84a-4a69ad593f75 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Returning 404 to user: Instance c2b8ba99-d845-4fca-b9e7-fc77ac91a601 could not be found. {{(pid=117562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 23:05:43.550513 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-34612a83-386e-4119-a84a-4a69ad593f75 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] 10.222.0.17 "GET /compute/v2.1/servers/c2b8ba99-d845-4fca-b9e7-fc77ac91a601" status: 404 len: 111 microversion: 2.1 time: 0.077673 Jun 16 23:05:43.551371 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 353/700] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:05:43 2022] GET /compute/v2.1/servers/c2b8ba99-d845-4fca-b9e7-fc77ac91a601 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 23:05:43.556717 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.compute.server_external_events [req-785bdccc-c122-44eb-a7a6-62ad33c9c420 req-186316d6-4d99-47f0-a2bd-5935b05e0038 service nova] Creating event network-vif-deleted:020e6819-d071-41f2-9573-ea592ee5004c for instance c2b8ba99-d845-4fca-b9e7-fc77ac91a601 on hv-cinder-84623 Jun 16 23:05:43.563996 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-250993cb-9fb5-4c58-89bc-91041f67b3e5 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:05:43.566059 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [req-785bdccc-c122-44eb-a7a6-62ad33c9c420 req-186316d6-4d99-47f0-a2bd-5935b05e0038 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074681 Jun 16 23:05:43.567118 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 348/701] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 23:05:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 23:05:43.574637 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-250993cb-9fb5-4c58-89bc-91041f67b3e5 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] [instance: 4ad3ba60-bc63-4d0a-be00-f9b00e66d803] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:05:43.581465 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-250993cb-9fb5-4c58-89bc-91041f67b3e5 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:43.581919 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-250993cb-9fb5-4c58-89bc-91041f67b3e5 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:43.582728 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-250993cb-9fb5-4c58-89bc-91041f67b3e5 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:43.583736 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-250993cb-9fb5-4c58-89bc-91041f67b3e5 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:43.604595 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [req-4bbbebe5-f585-460f-8a40-8134882c8772 req-92f42ba0-baae-4e46-8684-0745d0fd5cae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa81794d-bc81-49d2-b4dc-6f57b43ecfe8", "name": "network-vif-unplugged", "status": "completed", "tag": "218d229b-a7e5-4c33-9723-c6215e47e600"}]} {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 23:05:43.638716 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-4bbbebe5-f585-460f-8a40-8134882c8772 req-92f42ba0-baae-4e46-8684-0745d0fd5cae service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:43.639174 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-4bbbebe5-f585-460f-8a40-8134882c8772 req-92f42ba0-baae-4e46-8684-0745d0fd5cae service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:43.654118 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG dbcounter [-] [117563] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 23:05:43.656546 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-250993cb-9fb5-4c58-89bc-91041f67b3e5 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] [instance: 4ad3ba60-bc63-4d0a-be00-f9b00e66d803] Going to try to terminate instance {{(pid=117562) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 23:05:43.703289 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.compute.server_external_events [req-4bbbebe5-f585-460f-8a40-8134882c8772 req-92f42ba0-baae-4e46-8684-0745d0fd5cae service nova] Creating event network-vif-unplugged:218d229b-a7e5-4c33-9723-c6215e47e600 for instance aa81794d-bc81-49d2-b4dc-6f57b43ecfe8 on hv-cinder-84623 Jun 16 23:05:43.712110 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [req-4bbbebe5-f585-460f-8a40-8134882c8772 req-92f42ba0-baae-4e46-8684-0745d0fd5cae service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.115101 Jun 16 23:05:43.714616 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 349/702] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 23:05:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 23:05:43.769167 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-250993cb-9fb5-4c58-89bc-91041f67b3e5 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] 10.222.0.17 "DELETE /compute/v2.1/servers/4ad3ba60-bc63-4d0a-be00-f9b00e66d803" status: 204 len: 0 microversion: 2.1 time: 0.212407 Jun 16 23:05:43.769959 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 354/703] 10.222.0.17 () {58 vars in 1238 bytes} [Thu Jun 16 23:05:43 2022] DELETE /compute/v2.1/servers/4ad3ba60-bc63-4d0a-be00-f9b00e66d803 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 23:05:44.004739 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-ea5f7424-add1-4ca9-b424-077162589904 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:05:44.005539 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-ea5f7424-add1-4ca9-b424-077162589904 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] [instance: 4ad3ba60-bc63-4d0a-be00-f9b00e66d803] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:05:44.012859 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-ea5f7424-add1-4ca9-b424-077162589904 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:44.013378 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-ea5f7424-add1-4ca9-b424-077162589904 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:44.014211 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-ea5f7424-add1-4ca9-b424-077162589904 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:44.014678 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-ea5f7424-add1-4ca9-b424-077162589904 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:44.175454 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-2369eb95-3378-43dd-b9bf-dbf39d263f76 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:05:44.176278 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-2369eb95-3378-43dd-b9bf-dbf39d263f76 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] [instance: aa81794d-bc81-49d2-b4dc-6f57b43ecfe8] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:05:44.183035 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-2369eb95-3378-43dd-b9bf-dbf39d263f76 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:44.183487 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-2369eb95-3378-43dd-b9bf-dbf39d263f76 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:44.185326 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-2369eb95-3378-43dd-b9bf-dbf39d263f76 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:44.186715 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-2369eb95-3378-43dd-b9bf-dbf39d263f76 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:44.186861 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-ea5f7424-add1-4ca9-b424-077162589904 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '243e592fbf1844d89f55dd5035a684f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60447df5461141e883d207e028b74bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:05:44.198868 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-ea5f7424-add1-4ca9-b424-077162589904 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] 10.222.0.17 "GET /compute/v2.1/servers/4ad3ba60-bc63-4d0a-be00-f9b00e66d803" status: 200 len: 1521 microversion: 2.1 time: 0.423901 Jun 16 23:05:44.205890 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 350/704] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:05:43 2022] GET /compute/v2.1/servers/4ad3ba60-bc63-4d0a-be00-f9b00e66d803 => generated 1521 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:05:44.360258 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-2369eb95-3378-43dd-b9bf-dbf39d263f76 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01dd0e5661f44d05a01d7a5e82dbadf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b30b90ec4d5e45468a4fa0fb98e46393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:05:44.368486 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-2369eb95-3378-43dd-b9bf-dbf39d263f76 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] 10.222.0.17 "GET /compute/v2.1/servers/aa81794d-bc81-49d2-b4dc-6f57b43ecfe8" status: 200 len: 1574 microversion: 2.1 time: 0.198036 Jun 16 23:05:44.369377 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 355/705] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:05:44 2022] GET /compute/v2.1/servers/aa81794d-bc81-49d2-b4dc-6f57b43ecfe8 => generated 1574 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:05:44.665265 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-42b70bca-94af-4e45-9e2c-361dab4ab91b tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1149740319", "imageRef": "2b486731-e5ea-4159-b6b1-ed0083e00543", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9cf34f4a-7249-4d59-a812-ce9cab585661"}], "security_groups": [{"name": "tempest-securitygroup--161647491"}], "key_name": "tempest-keypair-1672104557", "user_data": "}} {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 23:05:45.191593 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.network.neutron [None req-42b70bca-94af-4e45-9e2c-361dab4ab91b tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] validate_networks() for [('9cf34f4a-7249-4d59-a812-ce9cab585661', None, None, None, None, None)] {{(pid=117563) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 23:05:45.215766 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-f34a9dbf-5f92-4bcf-beae-6d5700de8d3e tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:05:45.216384 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-f34a9dbf-5f92-4bcf-beae-6d5700de8d3e tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] [instance: 4ad3ba60-bc63-4d0a-be00-f9b00e66d803] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:05:45.223334 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-f34a9dbf-5f92-4bcf-beae-6d5700de8d3e tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:45.224352 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-f34a9dbf-5f92-4bcf-beae-6d5700de8d3e tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:45.225114 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-f34a9dbf-5f92-4bcf-beae-6d5700de8d3e tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:45.225554 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-f34a9dbf-5f92-4bcf-beae-6d5700de8d3e tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:45.510181 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-f34a9dbf-5f92-4bcf-beae-6d5700de8d3e tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '243e592fbf1844d89f55dd5035a684f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60447df5461141e883d207e028b74bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:05:45.517741 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-f34a9dbf-5f92-4bcf-beae-6d5700de8d3e tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] 10.222.0.17 "GET /compute/v2.1/servers/4ad3ba60-bc63-4d0a-be00-f9b00e66d803" status: 200 len: 1521 microversion: 2.1 time: 0.305836 Jun 16 23:05:45.518310 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 356/706] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:05:45 2022] GET /compute/v2.1/servers/4ad3ba60-bc63-4d0a-be00-f9b00e66d803 => generated 1521 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 23:05:45.523457 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-acc379be-5eed-44cf-91a6-0abb92a2a2b3 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:05:45.524266 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-acc379be-5eed-44cf-91a6-0abb92a2a2b3 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] [instance: aa81794d-bc81-49d2-b4dc-6f57b43ecfe8] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:05:45.530350 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-acc379be-5eed-44cf-91a6-0abb92a2a2b3 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:45.530787 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-acc379be-5eed-44cf-91a6-0abb92a2a2b3 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:45.531556 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-acc379be-5eed-44cf-91a6-0abb92a2a2b3 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:45.531990 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-acc379be-5eed-44cf-91a6-0abb92a2a2b3 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:45.801319 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-acc379be-5eed-44cf-91a6-0abb92a2a2b3 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01dd0e5661f44d05a01d7a5e82dbadf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b30b90ec4d5e45468a4fa0fb98e46393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:05:45.811385 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-acc379be-5eed-44cf-91a6-0abb92a2a2b3 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] 10.222.0.17 "GET /compute/v2.1/servers/aa81794d-bc81-49d2-b4dc-6f57b43ecfe8" status: 200 len: 1574 microversion: 2.1 time: 0.292007 Jun 16 23:05:45.821997 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 357/707] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:05:45 2022] GET /compute/v2.1/servers/aa81794d-bc81-49d2-b4dc-6f57b43ecfe8 => generated 1574 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:05:45.871643 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.virt.hardware [None req-42b70bca-94af-4e45-9e2c-361dab4ab91b tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Flavor limits 0:0:0 {{(pid=117563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 23:05:45.872408 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.virt.hardware [None req-42b70bca-94af-4e45-9e2c-361dab4ab91b tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Image limits 0:0:0 {{(pid=117563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 23:05:45.873250 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.virt.hardware [None req-42b70bca-94af-4e45-9e2c-361dab4ab91b tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Flavor pref 0:0:0 {{(pid=117563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 23:05:45.873993 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.virt.hardware [None req-42b70bca-94af-4e45-9e2c-361dab4ab91b tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Image pref 0:0:0 {{(pid=117563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 23:05:45.874659 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.virt.hardware [None req-42b70bca-94af-4e45-9e2c-361dab4ab91b tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 23:05:45.886184 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-42b70bca-94af-4e45-9e2c-361dab4ab91b tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:45.886930 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-42b70bca-94af-4e45-9e2c-361dab4ab91b tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:45.888174 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-42b70bca-94af-4e45-9e2c-361dab4ab91b tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:45.888913 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-42b70bca-94af-4e45-9e2c-361dab4ab91b tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:45.908509 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.quota [None req-42b70bca-94af-4e45-9e2c-361dab4ab91b tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Getting quotas for project f3b1be8431b0434d8bd6abca293127d5. Resources: {'instances', 'cores', 'ram'} {{(pid=117563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 23:05:45.913065 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.quota [None req-42b70bca-94af-4e45-9e2c-361dab4ab91b tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Getting quotas for user 6a993f5d14b64fccad723abecfcadf90 and project f3b1be8431b0434d8bd6abca293127d5. Resources: {'instances', 'cores', 'ram'} {{(pid=117563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 23:05:45.925856 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-42b70bca-94af-4e45-9e2c-361dab4ab91b tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Going to run 1 instances... {{(pid=117563) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 23:05:45.928773 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-42b70bca-94af-4e45-9e2c-361dab4ab91b tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] [instance: b7619c39-737f-440b-b676-8e920380d6c6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2b486731-e5ea-4159-b6b1-ed0083e00543',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117563) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 23:05:45.978412 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-42b70bca-94af-4e45-9e2c-361dab4ab91b tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.317917 Jun 16 23:05:45.979393 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 351/708] 10.222.0.17 () {60 vars in 1146 bytes} [Thu Jun 16 23:05:44 2022] POST /compute/v2.1/servers => generated 401 bytes in 1320 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 23:05:45.992874 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-98746135-f5e5-4b40-a38a-aa9daae0456f tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:05:45.993403 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-98746135-f5e5-4b40-a38a-aa9daae0456f tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] [instance: b7619c39-737f-440b-b676-8e920380d6c6] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:05:46.057987 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-98746135-f5e5-4b40-a38a-aa9daae0456f tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a993f5d14b64fccad723abecfcadf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b1be8431b0434d8bd6abca293127d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:05:46.066287 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-98746135-f5e5-4b40-a38a-aa9daae0456f tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] 10.222.0.17 "GET /compute/v2.1/servers/b7619c39-737f-440b-b676-8e920380d6c6" status: 200 len: 1238 microversion: 2.1 time: 0.077331 Jun 16 23:05:46.068253 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 358/709] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:05:45 2022] GET /compute/v2.1/servers/b7619c39-737f-440b-b676-8e920380d6c6 => generated 1238 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:05:46.547602 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-1b0289eb-00bc-45fc-9b3f-a078943f489f tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:05:46.548302 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-1b0289eb-00bc-45fc-9b3f-a078943f489f tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] [instance: 4ad3ba60-bc63-4d0a-be00-f9b00e66d803] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:05:46.556146 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-1b0289eb-00bc-45fc-9b3f-a078943f489f tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:46.556605 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-1b0289eb-00bc-45fc-9b3f-a078943f489f tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:46.557600 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-1b0289eb-00bc-45fc-9b3f-a078943f489f tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:46.558239 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-1b0289eb-00bc-45fc-9b3f-a078943f489f tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:46.707458 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-1b0289eb-00bc-45fc-9b3f-a078943f489f tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '243e592fbf1844d89f55dd5035a684f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60447df5461141e883d207e028b74bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:05:46.715444 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-1b0289eb-00bc-45fc-9b3f-a078943f489f tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] 10.222.0.17 "GET /compute/v2.1/servers/4ad3ba60-bc63-4d0a-be00-f9b00e66d803" status: 200 len: 1521 microversion: 2.1 time: 0.181418 Jun 16 23:05:46.716034 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 352/710] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:05:46 2022] GET /compute/v2.1/servers/4ad3ba60-bc63-4d0a-be00-f9b00e66d803 => generated 1521 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:05:46.831682 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-a8a2d037-c6b5-4c9e-91b3-3e0f72ed89f9 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:05:46.832303 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-a8a2d037-c6b5-4c9e-91b3-3e0f72ed89f9 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] [instance: aa81794d-bc81-49d2-b4dc-6f57b43ecfe8] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:05:46.840163 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-a8a2d037-c6b5-4c9e-91b3-3e0f72ed89f9 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:46.840616 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-a8a2d037-c6b5-4c9e-91b3-3e0f72ed89f9 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:46.841633 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-a8a2d037-c6b5-4c9e-91b3-3e0f72ed89f9 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:46.842045 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-a8a2d037-c6b5-4c9e-91b3-3e0f72ed89f9 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:47.047381 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-a8a2d037-c6b5-4c9e-91b3-3e0f72ed89f9 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01dd0e5661f44d05a01d7a5e82dbadf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b30b90ec4d5e45468a4fa0fb98e46393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:05:47.056662 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-a8a2d037-c6b5-4c9e-91b3-3e0f72ed89f9 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] 10.222.0.17 "GET /compute/v2.1/servers/aa81794d-bc81-49d2-b4dc-6f57b43ecfe8" status: 200 len: 1574 microversion: 2.1 time: 0.231556 Jun 16 23:05:47.057231 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 359/711] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:05:46 2022] GET /compute/v2.1/servers/aa81794d-bc81-49d2-b4dc-6f57b43ecfe8 => generated 1574 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:05:47.085185 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-8c6f8363-c42e-49c3-94ab-24d8ff3932a3 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:05:47.085888 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-8c6f8363-c42e-49c3-94ab-24d8ff3932a3 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] [instance: b7619c39-737f-440b-b676-8e920380d6c6] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:05:47.092959 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-8c6f8363-c42e-49c3-94ab-24d8ff3932a3 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:47.093673 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-8c6f8363-c42e-49c3-94ab-24d8ff3932a3 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:47.094448 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-8c6f8363-c42e-49c3-94ab-24d8ff3932a3 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:47.095073 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-8c6f8363-c42e-49c3-94ab-24d8ff3932a3 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:47.200556 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-8c6f8363-c42e-49c3-94ab-24d8ff3932a3 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a993f5d14b64fccad723abecfcadf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b1be8431b0434d8bd6abca293127d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:05:47.214244 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-8c6f8363-c42e-49c3-94ab-24d8ff3932a3 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] 10.222.0.17 "GET /compute/v2.1/servers/b7619c39-737f-440b-b676-8e920380d6c6" status: 200 len: 1234 microversion: 2.1 time: 0.133116 Jun 16 23:05:47.215487 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 353/712] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:05:47 2022] GET /compute/v2.1/servers/b7619c39-737f-440b-b676-8e920380d6c6 => generated 1234 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:05:47.732206 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-2c71605a-060e-41b5-958c-10121d34ba4d tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:05:47.732841 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-2c71605a-060e-41b5-958c-10121d34ba4d tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] [instance: 4ad3ba60-bc63-4d0a-be00-f9b00e66d803] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:05:47.742122 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-2c71605a-060e-41b5-958c-10121d34ba4d tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:47.742958 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-2c71605a-060e-41b5-958c-10121d34ba4d tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:47.743857 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-2c71605a-060e-41b5-958c-10121d34ba4d tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:47.744350 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-2c71605a-060e-41b5-958c-10121d34ba4d tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:47.920307 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-2c71605a-060e-41b5-958c-10121d34ba4d tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '243e592fbf1844d89f55dd5035a684f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60447df5461141e883d207e028b74bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:05:47.934461 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-2c71605a-060e-41b5-958c-10121d34ba4d tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] 10.222.0.17 "GET /compute/v2.1/servers/4ad3ba60-bc63-4d0a-be00-f9b00e66d803" status: 200 len: 1521 microversion: 2.1 time: 0.205974 Jun 16 23:05:47.935444 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 360/713] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:05:47 2022] GET /compute/v2.1/servers/4ad3ba60-bc63-4d0a-be00-f9b00e66d803 => generated 1521 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:05:48.074629 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-9e473358-196e-4c25-a621-8a181ca8c1aa tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:05:48.076386 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-9e473358-196e-4c25-a621-8a181ca8c1aa tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] [instance: aa81794d-bc81-49d2-b4dc-6f57b43ecfe8] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:05:48.085078 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-9e473358-196e-4c25-a621-8a181ca8c1aa tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:48.085886 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-9e473358-196e-4c25-a621-8a181ca8c1aa tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:48.087585 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-9e473358-196e-4c25-a621-8a181ca8c1aa tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:48.091725 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-9e473358-196e-4c25-a621-8a181ca8c1aa tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:48.246846 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-60e779ff-5750-413c-9971-b85f110c9c2d tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:05:48.247446 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-60e779ff-5750-413c-9971-b85f110c9c2d tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] [instance: b7619c39-737f-440b-b676-8e920380d6c6] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:05:48.257161 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-60e779ff-5750-413c-9971-b85f110c9c2d tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:48.262714 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-60e779ff-5750-413c-9971-b85f110c9c2d tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:48.263733 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-60e779ff-5750-413c-9971-b85f110c9c2d tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:48.264332 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-60e779ff-5750-413c-9971-b85f110c9c2d tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:48.499890 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-60e779ff-5750-413c-9971-b85f110c9c2d tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a993f5d14b64fccad723abecfcadf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b1be8431b0434d8bd6abca293127d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:05:48.523759 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-60e779ff-5750-413c-9971-b85f110c9c2d tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] 10.222.0.17 "GET /compute/v2.1/servers/b7619c39-737f-440b-b676-8e920380d6c6" status: 200 len: 1290 microversion: 2.1 time: 0.282877 Jun 16 23:05:48.527175 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 361/714] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:05:48 2022] GET /compute/v2.1/servers/b7619c39-737f-440b-b676-8e920380d6c6 => generated 1290 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:05:48.552711 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [req-7c2bfa08-722d-4a7f-b819-74fd37a38990 req-100df204-f05e-4b05-98ea-7c816774a983 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ad3ba60-bc63-4d0a-be00-f9b00e66d803", "name": "network-vif-deleted", "tag": "27dc1467-d62f-4447-a2e6-d4697ce9cdfa"}]} {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 23:05:48.567716 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [req-7c2bfa08-722d-4a7f-b819-74fd37a38990 req-100df204-f05e-4b05-98ea-7c816774a983 service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:48.573596 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [req-7c2bfa08-722d-4a7f-b819-74fd37a38990 req-100df204-f05e-4b05-98ea-7c816774a983 service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:48.600486 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.compute.server_external_events [req-7c2bfa08-722d-4a7f-b819-74fd37a38990 req-100df204-f05e-4b05-98ea-7c816774a983 service nova] Creating event network-vif-deleted:27dc1467-d62f-4447-a2e6-d4697ce9cdfa for instance 4ad3ba60-bc63-4d0a-be00-f9b00e66d803 on hv-cinder-84623 Jun 16 23:05:48.615727 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [req-7c2bfa08-722d-4a7f-b819-74fd37a38990 req-100df204-f05e-4b05-98ea-7c816774a983 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083562 Jun 16 23:05:48.616413 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 362/715] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 23:05:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 23:05:48.627303 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-9e473358-196e-4c25-a621-8a181ca8c1aa tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01dd0e5661f44d05a01d7a5e82dbadf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b30b90ec4d5e45468a4fa0fb98e46393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:05:48.640546 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-9e473358-196e-4c25-a621-8a181ca8c1aa tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] 10.222.0.17 "GET /compute/v2.1/servers/aa81794d-bc81-49d2-b4dc-6f57b43ecfe8" status: 200 len: 1574 microversion: 2.1 time: 0.570064 Jun 16 23:05:48.641908 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 354/716] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:05:48 2022] GET /compute/v2.1/servers/aa81794d-bc81-49d2-b4dc-6f57b43ecfe8 => generated 1574 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:05:48.961390 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-5df2baee-2bc0-46bd-99b2-a0c213813999 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:05:48.962353 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-5df2baee-2bc0-46bd-99b2-a0c213813999 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] [instance: 4ad3ba60-bc63-4d0a-be00-f9b00e66d803] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:05:48.972262 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-5df2baee-2bc0-46bd-99b2-a0c213813999 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:48.977997 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-5df2baee-2bc0-46bd-99b2-a0c213813999 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:48.979087 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-5df2baee-2bc0-46bd-99b2-a0c213813999 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:48.979940 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-5df2baee-2bc0-46bd-99b2-a0c213813999 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:49.018468 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-5df2baee-2bc0-46bd-99b2-a0c213813999 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:49.019294 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-5df2baee-2bc0-46bd-99b2-a0c213813999 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:49.020572 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.objects.instance [None req-5df2baee-2bc0-46bd-99b2-a0c213813999 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lazy-loading 'fault' on Instance uuid 4ad3ba60-bc63-4d0a-be00-f9b00e66d803 {{(pid=117562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 23:05:49.033067 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG dbcounter [-] [117562] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 23:05:49.157816 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-5df2baee-2bc0-46bd-99b2-a0c213813999 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '243e592fbf1844d89f55dd5035a684f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60447df5461141e883d207e028b74bc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:05:49.166172 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-5df2baee-2bc0-46bd-99b2-a0c213813999 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] 10.222.0.17 "GET /compute/v2.1/servers/4ad3ba60-bc63-4d0a-be00-f9b00e66d803" status: 200 len: 1311 microversion: 2.1 time: 0.213652 Jun 16 23:05:49.166792 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 363/717] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:05:48 2022] GET /compute/v2.1/servers/4ad3ba60-bc63-4d0a-be00-f9b00e66d803 => generated 1311 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:05:49.541956 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-4c471357-c001-4a6c-8575-df51c4f65554 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:05:49.542738 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-4c471357-c001-4a6c-8575-df51c4f65554 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] [instance: b7619c39-737f-440b-b676-8e920380d6c6] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:05:49.551965 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-4c471357-c001-4a6c-8575-df51c4f65554 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:49.552775 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-4c471357-c001-4a6c-8575-df51c4f65554 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:49.553812 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-4c471357-c001-4a6c-8575-df51c4f65554 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:49.554462 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-4c471357-c001-4a6c-8575-df51c4f65554 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:49.658118 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-aea29d52-299a-4721-b512-8b8ca028dcc9 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:05:49.658930 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-aea29d52-299a-4721-b512-8b8ca028dcc9 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] [instance: aa81794d-bc81-49d2-b4dc-6f57b43ecfe8] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:05:49.673978 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-4c471357-c001-4a6c-8575-df51c4f65554 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a993f5d14b64fccad723abecfcadf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b1be8431b0434d8bd6abca293127d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:05:49.674163 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-aea29d52-299a-4721-b512-8b8ca028dcc9 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:49.674624 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-aea29d52-299a-4721-b512-8b8ca028dcc9 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:49.675406 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-aea29d52-299a-4721-b512-8b8ca028dcc9 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:49.675837 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-aea29d52-299a-4721-b512-8b8ca028dcc9 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:49.683836 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-4c471357-c001-4a6c-8575-df51c4f65554 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] 10.222.0.17 "GET /compute/v2.1/servers/b7619c39-737f-440b-b676-8e920380d6c6" status: 200 len: 1296 microversion: 2.1 time: 0.146097 Jun 16 23:05:49.693790 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 355/718] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:05:49 2022] GET /compute/v2.1/servers/b7619c39-737f-440b-b676-8e920380d6c6 => generated 1296 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:05:49.883219 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-aea29d52-299a-4721-b512-8b8ca028dcc9 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01dd0e5661f44d05a01d7a5e82dbadf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b30b90ec4d5e45468a4fa0fb98e46393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:05:49.891414 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-aea29d52-299a-4721-b512-8b8ca028dcc9 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] 10.222.0.17 "GET /compute/v2.1/servers/aa81794d-bc81-49d2-b4dc-6f57b43ecfe8" status: 200 len: 1574 microversion: 2.1 time: 0.237937 Jun 16 23:05:49.891994 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 364/719] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:05:49 2022] GET /compute/v2.1/servers/aa81794d-bc81-49d2-b4dc-6f57b43ecfe8 => generated 1574 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 23:05:50.199735 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-349afec7-586c-4f6f-be97-04f0dab7f147 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:05:50.212939 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-349afec7-586c-4f6f-be97-04f0dab7f147 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] [instance: 4ad3ba60-bc63-4d0a-be00-f9b00e66d803] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:05:50.249277 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-349afec7-586c-4f6f-be97-04f0dab7f147 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:50.260603 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-349afec7-586c-4f6f-be97-04f0dab7f147 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:50.263101 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-349afec7-586c-4f6f-be97-04f0dab7f147 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:50.267074 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-349afec7-586c-4f6f-be97-04f0dab7f147 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:50.307712 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.wsgi [None req-349afec7-586c-4f6f-be97-04f0dab7f147 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] HTTP exception thrown: Instance 4ad3ba60-bc63-4d0a-be00-f9b00e66d803 could not be found. Jun 16 23:05:50.309984 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-349afec7-586c-4f6f-be97-04f0dab7f147 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Request method failure captured: Jun 16 23:05:50.309984 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: request: GET /compute/v2.1/servers/4ad3ba60-bc63-4d0a-be00-f9b00e66d803 HTTP/1.1 Jun 16 23:05:50.309984 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Accept: application/json Jun 16 23:05:50.309984 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Accept-Encoding: identity Jun 16 23:05:50.309984 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Connection: close Jun 16 23:05:50.309984 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Content-Length: 0 Jun 16 23:05:50.309984 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Content-Type: application/json Jun 16 23:05:50.309984 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Host: 10.222.0.17 Jun 16 23:05:50.309984 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Openstack-System-Scope: None Jun 16 23:05:50.309984 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: User-Agent: python-urllib3/1.26.9 Jun 16 23:05:50.309984 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Auth-Token: gAAAAABiq7Ybpb0QO0FcFn_EOw5P6FTbOHo1mCVh1QS4wC871UGlRsfydiFbvefR_ouEKZbaz8Cp87VYbn--bsc0A8Z56HhTuujXXbcpoO2sA3ojRA0C8Q-lwRF3sq-FBCCjaN6ItRbHJC1L8ezexrcUPCnREK8HUDeFj-L4igPJ9X0jeAiI_Ic Jun 16 23:05:50.309984 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Domain-Id: None Jun 16 23:05:50.309984 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Domain-Name: None Jun 16 23:05:50.309984 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Identity-Status: Confirmed Jun 16 23:05:50.309984 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Is-Admin-Project: True Jun 16 23:05:50.309984 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Project-Domain-Id: default Jun 16 23:05:50.309984 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Project-Domain-Name: Default Jun 16 23:05:50.309984 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Project-Id: 60447df5461141e883d207e028b74bc7 Jun 16 23:05:50.309984 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1782574210 Jun 16 23:05:50.309984 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Role: member,reader Jun 16 23:05:50.309984 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Roles: member,reader Jun 16 23:05:50.311404 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/60447df5461141e883d207e028b74bc7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_60447df5461141e883d207e028b74bc7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/60447df5461141e883d207e028b74bc7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/60447df5461141e883d207e028b74bc7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Jun 16 23:05:50.311404 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1782574210 Jun 16 23:05:50.311404 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Tenant-Id: 60447df5461141e883d207e028b74bc7 Jun 16 23:05:50.311404 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1782574210 Jun 16 23:05:50.311404 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-User: tempest-ServerRescueNegativeTestJSON-1782574210-project Jun 16 23:05:50.311404 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-User-Domain-Id: default Jun 16 23:05:50.311404 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-User-Domain-Name: Default Jun 16 23:05:50.311404 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-User-Id: 243e592fbf1844d89f55dd5035a684f3 Jun 16 23:05:50.311404 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1782574210-project Jun 16 23:05:50.311404 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: method: > Jun 16 23:05:50.311404 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: exception: Instance 4ad3ba60-bc63-4d0a-be00-f9b00e66d803 could not be found. Jun 16 23:05:50.311404 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: action_args: {'id': '4ad3ba60-bc63-4d0a-be00-f9b00e66d803'} Jun 16 23:05:50.312150 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 23:05:50.312150 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 23:05:50.312150 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 23:05:50.312150 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 23:05:50.312150 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 23:05:50.312150 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 23:05:50.312150 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 23:05:50.312150 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 23:05:50.312150 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 23:05:50.312150 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 23:05:50.312150 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ad3ba60-bc63-4d0a-be00-f9b00e66d803 could not be found. Jun 16 23:05:50.312150 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 16 23:05:50.312150 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 23:05:50.312150 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 16 23:05:50.312150 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 23:05:50.312150 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 23:05:50.312150 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 23:05:50.312150 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 23:05:50.312150 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 23:05:50.312150 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 23:05:50.313439 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 23:05:50.313439 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 23:05:50.313439 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 23:05:50.313439 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 23:05:50.313439 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 23:05:50.313439 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 23:05:50.313439 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 23:05:50.313439 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ad3ba60-bc63-4d0a-be00-f9b00e66d803 could not be found. Jun 16 23:05:50.313439 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 16 23:05:50.313439 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 23:05:50.313439 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 16 23:05:50.313439 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 23:05:50.313439 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 23:05:50.313439 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 23:05:50.313439 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 23:05:50.313439 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 23:05:50.313439 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ad3ba60-bc63-4d0a-be00-f9b00e66d803 could not be found. Jun 16 23:05:50.313439 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 16 23:05:50.317233 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-349afec7-586c-4f6f-be97-04f0dab7f147 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] Returning 404 to user: Instance 4ad3ba60-bc63-4d0a-be00-f9b00e66d803 could not be found. {{(pid=117563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 23:05:50.318361 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-349afec7-586c-4f6f-be97-04f0dab7f147 tempest-ServerRescueNegativeTestJSON-1782574210 tempest-ServerRescueNegativeTestJSON-1782574210-project] 10.222.0.17 "GET /compute/v2.1/servers/4ad3ba60-bc63-4d0a-be00-f9b00e66d803" status: 404 len: 111 microversion: 2.1 time: 0.137761 Jun 16 23:05:50.319360 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 356/720] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:05:50 2022] GET /compute/v2.1/servers/4ad3ba60-bc63-4d0a-be00-f9b00e66d803 => generated 111 bytes in 140 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 23:05:50.701175 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-921aaaa9-8a7e-46e5-b633-36e582324c3b tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:05:50.702751 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-921aaaa9-8a7e-46e5-b633-36e582324c3b tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] [instance: b7619c39-737f-440b-b676-8e920380d6c6] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:05:50.710260 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-921aaaa9-8a7e-46e5-b633-36e582324c3b tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:50.711290 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-921aaaa9-8a7e-46e5-b633-36e582324c3b tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:50.712137 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-921aaaa9-8a7e-46e5-b633-36e582324c3b tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:50.712772 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-921aaaa9-8a7e-46e5-b633-36e582324c3b tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:50.911240 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-a3d87735-bc24-4201-bcfd-dc4427de1305 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:05:50.912692 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-a3d87735-bc24-4201-bcfd-dc4427de1305 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] [instance: aa81794d-bc81-49d2-b4dc-6f57b43ecfe8] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:05:50.919571 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-a3d87735-bc24-4201-bcfd-dc4427de1305 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:50.920250 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-a3d87735-bc24-4201-bcfd-dc4427de1305 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:50.921226 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-a3d87735-bc24-4201-bcfd-dc4427de1305 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:50.921664 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-a3d87735-bc24-4201-bcfd-dc4427de1305 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:51.149050 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-921aaaa9-8a7e-46e5-b633-36e582324c3b tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a993f5d14b64fccad723abecfcadf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b1be8431b0434d8bd6abca293127d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:05:51.168239 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-921aaaa9-8a7e-46e5-b633-36e582324c3b tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] 10.222.0.17 "GET /compute/v2.1/servers/b7619c39-737f-440b-b676-8e920380d6c6" status: 200 len: 1363 microversion: 2.1 time: 0.470764 Jun 16 23:05:51.180369 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 365/721] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:05:50 2022] GET /compute/v2.1/servers/b7619c39-737f-440b-b676-8e920380d6c6 => generated 1363 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 23:05:51.688887 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-a3d87735-bc24-4201-bcfd-dc4427de1305 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01dd0e5661f44d05a01d7a5e82dbadf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b30b90ec4d5e45468a4fa0fb98e46393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:05:51.697713 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-a3d87735-bc24-4201-bcfd-dc4427de1305 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] 10.222.0.17 "GET /compute/v2.1/servers/aa81794d-bc81-49d2-b4dc-6f57b43ecfe8" status: 200 len: 1574 microversion: 2.1 time: 0.792624 Jun 16 23:05:51.707781 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 357/722] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:05:50 2022] GET /compute/v2.1/servers/aa81794d-bc81-49d2-b4dc-6f57b43ecfe8 => generated 1574 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:05:52.186158 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-f87a4d23-5b84-4ce8-b2b5-9298bff5bf2d tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:05:52.188041 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-f87a4d23-5b84-4ce8-b2b5-9298bff5bf2d tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] [instance: b7619c39-737f-440b-b676-8e920380d6c6] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:05:52.195847 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-f87a4d23-5b84-4ce8-b2b5-9298bff5bf2d tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:52.196622 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-f87a4d23-5b84-4ce8-b2b5-9298bff5bf2d tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:52.197642 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-f87a4d23-5b84-4ce8-b2b5-9298bff5bf2d tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:52.198322 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-f87a4d23-5b84-4ce8-b2b5-9298bff5bf2d tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:52.296906 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [req-a611801a-7264-4299-a428-8753d38433be req-49fc47df-9d8d-4fa3-8333-b83153ca661d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7619c39-737f-440b-b676-8e920380d6c6", "tag": "f3bd5725-2a88-4068-b338-b761ad56e180"}]} {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 23:05:52.342398 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-a611801a-7264-4299-a428-8753d38433be req-49fc47df-9d8d-4fa3-8333-b83153ca661d service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:52.342872 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-a611801a-7264-4299-a428-8753d38433be req-49fc47df-9d8d-4fa3-8333-b83153ca661d service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:52.363052 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.compute.server_external_events [req-a611801a-7264-4299-a428-8753d38433be req-49fc47df-9d8d-4fa3-8333-b83153ca661d service nova] Creating event network-changed:f3bd5725-2a88-4068-b338-b761ad56e180 for instance b7619c39-737f-440b-b676-8e920380d6c6 on hv-cinder-84623 Jun 16 23:05:52.376049 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [req-a611801a-7264-4299-a428-8753d38433be req-49fc47df-9d8d-4fa3-8333-b83153ca661d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092928 Jun 16 23:05:52.377495 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 358/723] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 23:05:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 23:05:52.657224 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-f87a4d23-5b84-4ce8-b2b5-9298bff5bf2d tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a993f5d14b64fccad723abecfcadf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b1be8431b0434d8bd6abca293127d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:05:52.668012 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-f87a4d23-5b84-4ce8-b2b5-9298bff5bf2d tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] 10.222.0.17 "GET /compute/v2.1/servers/b7619c39-737f-440b-b676-8e920380d6c6" status: 200 len: 1363 microversion: 2.1 time: 0.485427 Jun 16 23:05:52.669333 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 366/724] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:05:52 2022] GET /compute/v2.1/servers/b7619c39-737f-440b-b676-8e920380d6c6 => generated 1363 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:05:52.723139 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-6fac7ee9-88f4-4cb8-abde-71fdb7333471 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:05:52.724677 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-6fac7ee9-88f4-4cb8-abde-71fdb7333471 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] [instance: aa81794d-bc81-49d2-b4dc-6f57b43ecfe8] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:05:52.733913 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-6fac7ee9-88f4-4cb8-abde-71fdb7333471 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:52.735035 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-6fac7ee9-88f4-4cb8-abde-71fdb7333471 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:52.736035 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-6fac7ee9-88f4-4cb8-abde-71fdb7333471 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:52.736539 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-6fac7ee9-88f4-4cb8-abde-71fdb7333471 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:53.133466 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-6fac7ee9-88f4-4cb8-abde-71fdb7333471 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01dd0e5661f44d05a01d7a5e82dbadf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b30b90ec4d5e45468a4fa0fb98e46393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:05:53.143148 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-6fac7ee9-88f4-4cb8-abde-71fdb7333471 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] 10.222.0.17 "GET /compute/v2.1/servers/aa81794d-bc81-49d2-b4dc-6f57b43ecfe8" status: 200 len: 1574 microversion: 2.1 time: 0.430606 Jun 16 23:05:53.144593 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 359/725] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:05:52 2022] GET /compute/v2.1/servers/aa81794d-bc81-49d2-b4dc-6f57b43ecfe8 => generated 1574 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:05:53.685740 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-28dfed09-36b4-4104-8637-2b8a08631327 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:05:53.686444 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-28dfed09-36b4-4104-8637-2b8a08631327 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] [instance: b7619c39-737f-440b-b676-8e920380d6c6] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:05:53.697202 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-28dfed09-36b4-4104-8637-2b8a08631327 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:53.702561 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-28dfed09-36b4-4104-8637-2b8a08631327 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:53.703702 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-28dfed09-36b4-4104-8637-2b8a08631327 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:53.704225 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-28dfed09-36b4-4104-8637-2b8a08631327 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:53.910969 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-28dfed09-36b4-4104-8637-2b8a08631327 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a993f5d14b64fccad723abecfcadf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b1be8431b0434d8bd6abca293127d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:05:53.926907 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-28dfed09-36b4-4104-8637-2b8a08631327 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] 10.222.0.17 "GET /compute/v2.1/servers/b7619c39-737f-440b-b676-8e920380d6c6" status: 200 len: 1363 microversion: 2.1 time: 0.240983 Jun 16 23:05:53.937244 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 367/726] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:05:53 2022] GET /compute/v2.1/servers/b7619c39-737f-440b-b676-8e920380d6c6 => generated 1363 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:05:54.161240 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-e6246ed3-e24c-4291-982d-9f5682f257c2 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:05:54.161956 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-e6246ed3-e24c-4291-982d-9f5682f257c2 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] [instance: aa81794d-bc81-49d2-b4dc-6f57b43ecfe8] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:05:54.180708 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-e6246ed3-e24c-4291-982d-9f5682f257c2 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:54.181504 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-e6246ed3-e24c-4291-982d-9f5682f257c2 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:54.184176 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-e6246ed3-e24c-4291-982d-9f5682f257c2 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:54.184849 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-e6246ed3-e24c-4291-982d-9f5682f257c2 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:54.894701 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-e6246ed3-e24c-4291-982d-9f5682f257c2 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01dd0e5661f44d05a01d7a5e82dbadf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b30b90ec4d5e45468a4fa0fb98e46393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:05:54.905657 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-e6246ed3-e24c-4291-982d-9f5682f257c2 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] 10.222.0.17 "GET /compute/v2.1/servers/aa81794d-bc81-49d2-b4dc-6f57b43ecfe8" status: 200 len: 1574 microversion: 2.1 time: 0.749029 Jun 16 23:05:54.924859 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 360/727] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:05:54 2022] GET /compute/v2.1/servers/aa81794d-bc81-49d2-b4dc-6f57b43ecfe8 => generated 1574 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:05:54.944357 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-be89f9b3-24e3-4816-a4d8-b4835479465c tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:05:54.945647 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-be89f9b3-24e3-4816-a4d8-b4835479465c tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] [instance: b7619c39-737f-440b-b676-8e920380d6c6] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:05:54.953271 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-be89f9b3-24e3-4816-a4d8-b4835479465c tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:54.953731 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-be89f9b3-24e3-4816-a4d8-b4835479465c tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:54.958788 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-be89f9b3-24e3-4816-a4d8-b4835479465c tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:54.959302 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-be89f9b3-24e3-4816-a4d8-b4835479465c tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:55.292698 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-be89f9b3-24e3-4816-a4d8-b4835479465c tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a993f5d14b64fccad723abecfcadf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b1be8431b0434d8bd6abca293127d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:05:55.307590 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-be89f9b3-24e3-4816-a4d8-b4835479465c tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] 10.222.0.17 "GET /compute/v2.1/servers/b7619c39-737f-440b-b676-8e920380d6c6" status: 200 len: 1363 microversion: 2.1 time: 0.366829 Jun 16 23:05:55.311364 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 368/728] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:05:54 2022] GET /compute/v2.1/servers/b7619c39-737f-440b-b676-8e920380d6c6 => generated 1363 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:05:55.944696 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-3edbbe4c-9deb-458f-91aa-c4761d009709 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:05:55.945909 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-3edbbe4c-9deb-458f-91aa-c4761d009709 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] [instance: aa81794d-bc81-49d2-b4dc-6f57b43ecfe8] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:05:55.949185 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG dbcounter [-] [117563] Writing DB stats nova_cell0:SELECT=2 {{(pid=117563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 23:05:55.952054 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG dbcounter [-] [117563] Writing DB stats nova_cell0:SELECT=6 {{(pid=117563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 23:05:55.963767 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-3edbbe4c-9deb-458f-91aa-c4761d009709 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:55.964655 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-3edbbe4c-9deb-458f-91aa-c4761d009709 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:55.965670 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-3edbbe4c-9deb-458f-91aa-c4761d009709 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:55.966293 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-3edbbe4c-9deb-458f-91aa-c4761d009709 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:56.328158 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-c6050424-1149-4cae-b33e-902765997eff tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:05:56.328777 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-c6050424-1149-4cae-b33e-902765997eff tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] [instance: b7619c39-737f-440b-b676-8e920380d6c6] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:05:56.331305 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG dbcounter [-] [117562] Writing DB stats nova_cell0:SELECT=6 {{(pid=117562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 23:05:56.337476 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-c6050424-1149-4cae-b33e-902765997eff tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:56.338125 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-c6050424-1149-4cae-b33e-902765997eff tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:56.339186 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-c6050424-1149-4cae-b33e-902765997eff tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:56.339777 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-c6050424-1149-4cae-b33e-902765997eff tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:56.380262 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-3edbbe4c-9deb-458f-91aa-c4761d009709 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01dd0e5661f44d05a01d7a5e82dbadf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b30b90ec4d5e45468a4fa0fb98e46393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:05:56.389163 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-3edbbe4c-9deb-458f-91aa-c4761d009709 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] 10.222.0.17 "GET /compute/v2.1/servers/aa81794d-bc81-49d2-b4dc-6f57b43ecfe8" status: 200 len: 1574 microversion: 2.1 time: 0.451087 Jun 16 23:05:56.394874 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 361/729] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:05:55 2022] GET /compute/v2.1/servers/aa81794d-bc81-49d2-b4dc-6f57b43ecfe8 => generated 1574 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:05:56.828158 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-c6050424-1149-4cae-b33e-902765997eff tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a993f5d14b64fccad723abecfcadf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b1be8431b0434d8bd6abca293127d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:05:56.843610 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-c6050424-1149-4cae-b33e-902765997eff tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] 10.222.0.17 "GET /compute/v2.1/servers/b7619c39-737f-440b-b676-8e920380d6c6" status: 200 len: 1363 microversion: 2.1 time: 0.519740 Jun 16 23:05:56.844219 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 369/730] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:05:56 2022] GET /compute/v2.1/servers/b7619c39-737f-440b-b676-8e920380d6c6 => generated 1363 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 23:05:57.406210 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-ef313104-972f-4e7e-ad69-0b00484d5aff tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:05:57.407489 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-ef313104-972f-4e7e-ad69-0b00484d5aff tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] [instance: aa81794d-bc81-49d2-b4dc-6f57b43ecfe8] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:05:57.414809 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-ef313104-972f-4e7e-ad69-0b00484d5aff tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:57.415514 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-ef313104-972f-4e7e-ad69-0b00484d5aff tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:57.416471 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-ef313104-972f-4e7e-ad69-0b00484d5aff tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:57.417075 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-ef313104-972f-4e7e-ad69-0b00484d5aff tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:57.579345 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-ef313104-972f-4e7e-ad69-0b00484d5aff tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01dd0e5661f44d05a01d7a5e82dbadf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b30b90ec4d5e45468a4fa0fb98e46393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:05:57.588805 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-ef313104-972f-4e7e-ad69-0b00484d5aff tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] 10.222.0.17 "GET /compute/v2.1/servers/aa81794d-bc81-49d2-b4dc-6f57b43ecfe8" status: 200 len: 1561 microversion: 2.1 time: 0.187268 Jun 16 23:05:57.590024 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 362/731] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:05:57 2022] GET /compute/v2.1/servers/aa81794d-bc81-49d2-b4dc-6f57b43ecfe8 => generated 1561 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:05:57.877242 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-6345170f-9b5a-4075-a570-1b07d380522d tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:05:57.880509 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-6345170f-9b5a-4075-a570-1b07d380522d tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] [instance: b7619c39-737f-440b-b676-8e920380d6c6] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:05:57.902718 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-6345170f-9b5a-4075-a570-1b07d380522d tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:57.903495 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-6345170f-9b5a-4075-a570-1b07d380522d tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:57.904511 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-6345170f-9b5a-4075-a570-1b07d380522d tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:57.904961 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-6345170f-9b5a-4075-a570-1b07d380522d tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:58.093408 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-6345170f-9b5a-4075-a570-1b07d380522d tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a993f5d14b64fccad723abecfcadf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b1be8431b0434d8bd6abca293127d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:05:58.102155 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-6345170f-9b5a-4075-a570-1b07d380522d tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] 10.222.0.17 "GET /compute/v2.1/servers/b7619c39-737f-440b-b676-8e920380d6c6" status: 200 len: 1363 microversion: 2.1 time: 0.245941 Jun 16 23:05:58.102780 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 370/732] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:05:57 2022] GET /compute/v2.1/servers/b7619c39-737f-440b-b676-8e920380d6c6 => generated 1363 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:05:58.155592 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-bfa514a6-817a-4b7a-bab9-30c036277fee tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Action: 'create', calling method: .version_select at 0x7f53135f9c10>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1351668635", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIZpN3HpccpUDWkzKpgFRvGKNNaOW8meC2c5eb1LeWrRhE09lxy8IfvtC1C8nA3MLFWhBb0SjN5Kv2GT3aqGTZVRvjfwEl/0N256lbRe20sGUB2lzxL8KVHaCRz3GbXNUg=="}} {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 23:05:58.170041 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.quota [None req-bfa514a6-817a-4b7a-bab9-30c036277fee tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Getting quotas for project 1423c05c42b14519b401e22e16062781. Resources: {'key_pairs'} {{(pid=117563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 23:05:58.174359 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.quota [None req-bfa514a6-817a-4b7a-bab9-30c036277fee tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Getting quotas for user 2697aa77265e4f5783f87ffb3d4992b5 and project 1423c05c42b14519b401e22e16062781. Resources: {'key_pairs'} {{(pid=117563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 23:05:58.211585 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-bfa514a6-817a-4b7a-bab9-30c036277fee tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.316450 Jun 16 23:05:58.212574 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 363/733] 10.222.0.17 () {60 vars in 1158 bytes} [Thu Jun 16 23:05:57 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 23:05:59.119458 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-82acbb23-f340-4f8f-ae18-cf8fcba43200 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:05:59.121013 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-82acbb23-f340-4f8f-ae18-cf8fcba43200 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] [instance: b7619c39-737f-440b-b676-8e920380d6c6] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:05:59.129533 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-82acbb23-f340-4f8f-ae18-cf8fcba43200 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:59.129988 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-82acbb23-f340-4f8f-ae18-cf8fcba43200 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:59.130814 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-82acbb23-f340-4f8f-ae18-cf8fcba43200 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:59.131327 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-82acbb23-f340-4f8f-ae18-cf8fcba43200 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:59.400527 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-82acbb23-f340-4f8f-ae18-cf8fcba43200 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a993f5d14b64fccad723abecfcadf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b1be8431b0434d8bd6abca293127d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:05:59.409563 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-82acbb23-f340-4f8f-ae18-cf8fcba43200 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] 10.222.0.17 "GET /compute/v2.1/servers/b7619c39-737f-440b-b676-8e920380d6c6" status: 200 len: 1363 microversion: 2.1 time: 0.293837 Jun 16 23:05:59.418906 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 371/734] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:05:59 2022] GET /compute/v2.1/servers/b7619c39-737f-440b-b676-8e920380d6c6 => generated 1363 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:05:59.864301 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-442d2a5a-9f74-417b-acad-2deb027b323c tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:05:59.864742 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-442d2a5a-9f74-417b-acad-2deb027b323c tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] [instance: 30b2118a-225b-457b-a15d-cf7656c69331] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:05:59.874710 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-442d2a5a-9f74-417b-acad-2deb027b323c tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:59.875177 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-442d2a5a-9f74-417b-acad-2deb027b323c tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:59.875959 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-442d2a5a-9f74-417b-acad-2deb027b323c tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:05:59.876397 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-442d2a5a-9f74-417b-acad-2deb027b323c tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:05:59.910668 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-442d2a5a-9f74-417b-acad-2deb027b323c tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] 10.222.0.17 "GET /compute/v2.1/servers/30b2118a-225b-457b-a15d-cf7656c69331/ips" status: 200 len: 149 microversion: 2.1 time: 0.326332 Jun 16 23:05:59.911229 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 364/735] 10.222.0.17 () {58 vars in 1247 bytes} [Thu Jun 16 23:05:59 2022] GET /compute/v2.1/servers/30b2118a-225b-457b-a15d-cf7656c69331/ips => generated 149 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 23:06:00.426804 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-49654ec1-34b0-47ec-ab17-5bf05295c9da tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:06:00.427861 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-49654ec1-34b0-47ec-ab17-5bf05295c9da tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] [instance: b7619c39-737f-440b-b676-8e920380d6c6] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:06:00.434334 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-49654ec1-34b0-47ec-ab17-5bf05295c9da tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:00.434815 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-49654ec1-34b0-47ec-ab17-5bf05295c9da tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:00.435760 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-49654ec1-34b0-47ec-ab17-5bf05295c9da tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:00.436603 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-49654ec1-34b0-47ec-ab17-5bf05295c9da tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:00.609651 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-49654ec1-34b0-47ec-ab17-5bf05295c9da tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a993f5d14b64fccad723abecfcadf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b1be8431b0434d8bd6abca293127d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:06:00.618948 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-49654ec1-34b0-47ec-ab17-5bf05295c9da tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] 10.222.0.17 "GET /compute/v2.1/servers/b7619c39-737f-440b-b676-8e920380d6c6" status: 200 len: 1363 microversion: 2.1 time: 0.196126 Jun 16 23:06:00.619565 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 372/736] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:06:00 2022] GET /compute/v2.1/servers/b7619c39-737f-440b-b676-8e920380d6c6 => generated 1363 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:06:01.363510 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-cafc1166-070a-4ba1-a65f-cc57faed360e tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b22cc136-ffa1-4c00-ad99-9ec540914873"}} {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 23:06:01.367498 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-cafc1166-070a-4ba1-a65f-cc57faed360e tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] [instance: 30b2118a-225b-457b-a15d-cf7656c69331] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:06:01.377435 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-cafc1166-070a-4ba1-a65f-cc57faed360e tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:01.378023 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-cafc1166-070a-4ba1-a65f-cc57faed360e tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:01.379298 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-cafc1166-070a-4ba1-a65f-cc57faed360e tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:01.379823 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-cafc1166-070a-4ba1-a65f-cc57faed360e tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:01.433032 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [req-a1144214-4899-42ce-8706-c79b9618cad1 req-dd3ea373-881d-4ba7-9399-ca2452ea7020 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7619c39-737f-440b-b676-8e920380d6c6", "name": "network-vif-plugged", "status": "completed", "tag": "f3bd5725-2a88-4068-b338-b761ad56e180"}]} {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 23:06:01.444488 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [req-a1144214-4899-42ce-8706-c79b9618cad1 req-dd3ea373-881d-4ba7-9399-ca2452ea7020 service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:01.444943 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [req-a1144214-4899-42ce-8706-c79b9618cad1 req-dd3ea373-881d-4ba7-9399-ca2452ea7020 service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:01.458800 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.compute.server_external_events [req-a1144214-4899-42ce-8706-c79b9618cad1 req-dd3ea373-881d-4ba7-9399-ca2452ea7020 service nova] Creating event network-vif-plugged:f3bd5725-2a88-4068-b338-b761ad56e180 for instance b7619c39-737f-440b-b676-8e920380d6c6 on hv-cinder-84623 Jun 16 23:06:01.464185 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [req-a1144214-4899-42ce-8706-c79b9618cad1 req-dd3ea373-881d-4ba7-9399-ca2452ea7020 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034730 Jun 16 23:06:01.465326 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 373/737] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 23:06:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 23:06:01.636893 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-ef370857-2718-48fe-ad0e-768077c2769f tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:06:01.638199 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-ef370857-2718-48fe-ad0e-768077c2769f tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] [instance: b7619c39-737f-440b-b676-8e920380d6c6] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:06:01.652560 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-ef370857-2718-48fe-ad0e-768077c2769f tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:01.653793 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-ef370857-2718-48fe-ad0e-768077c2769f tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:01.654961 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-ef370857-2718-48fe-ad0e-768077c2769f tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:01.655905 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-ef370857-2718-48fe-ad0e-768077c2769f tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:01.760623 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-cafc1166-070a-4ba1-a65f-cc57faed360e tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] 10.222.0.17 "POST /compute/v2.1/servers/30b2118a-225b-457b-a15d-cf7656c69331/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.404940 Jun 16 23:06:01.761558 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 365/738] 10.222.0.17 () {60 vars in 1322 bytes} [Thu Jun 16 23:06:01 2022] POST /compute/v2.1/servers/30b2118a-225b-457b-a15d-cf7656c69331/os-volume_attachments => generated 194 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 23:06:02.013057 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-ef370857-2718-48fe-ad0e-768077c2769f tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a993f5d14b64fccad723abecfcadf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b1be8431b0434d8bd6abca293127d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:06:02.024459 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-ef370857-2718-48fe-ad0e-768077c2769f tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] 10.222.0.17 "GET /compute/v2.1/servers/b7619c39-737f-440b-b676-8e920380d6c6" status: 200 len: 1363 microversion: 2.1 time: 0.392544 Jun 16 23:06:02.025048 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 374/739] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:06:01 2022] GET /compute/v2.1/servers/b7619c39-737f-440b-b676-8e920380d6c6 => generated 1363 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:06:03.043648 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-bcb09b93-6495-4b25-8312-9973a5c960b7 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:06:03.044372 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-bcb09b93-6495-4b25-8312-9973a5c960b7 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] [instance: b7619c39-737f-440b-b676-8e920380d6c6] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:06:03.056699 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-bcb09b93-6495-4b25-8312-9973a5c960b7 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:03.058396 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-bcb09b93-6495-4b25-8312-9973a5c960b7 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:03.060169 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-bcb09b93-6495-4b25-8312-9973a5c960b7 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:03.062871 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-bcb09b93-6495-4b25-8312-9973a5c960b7 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:03.313793 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-bcb09b93-6495-4b25-8312-9973a5c960b7 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a993f5d14b64fccad723abecfcadf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b1be8431b0434d8bd6abca293127d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:06:03.321869 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-bcb09b93-6495-4b25-8312-9973a5c960b7 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] 10.222.0.17 "GET /compute/v2.1/servers/b7619c39-737f-440b-b676-8e920380d6c6" status: 200 len: 1363 microversion: 2.1 time: 0.283646 Jun 16 23:06:03.322456 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 366/740] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:06:03 2022] GET /compute/v2.1/servers/b7619c39-737f-440b-b676-8e920380d6c6 => generated 1363 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:06:03.520554 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [req-0b695689-16aa-414e-85d0-2e3eb100a743 req-3b0becc4-7742-4027-b4d5-75562cf1311a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa81794d-bc81-49d2-b4dc-6f57b43ecfe8", "name": "network-vif-plugged", "status": "completed", "tag": "218d229b-a7e5-4c33-9723-c6215e47e600"}]} {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 23:06:03.543649 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [req-0b695689-16aa-414e-85d0-2e3eb100a743 req-3b0becc4-7742-4027-b4d5-75562cf1311a service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:03.544323 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [req-0b695689-16aa-414e-85d0-2e3eb100a743 req-3b0becc4-7742-4027-b4d5-75562cf1311a service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:03.560172 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.compute.server_external_events [req-0b695689-16aa-414e-85d0-2e3eb100a743 req-3b0becc4-7742-4027-b4d5-75562cf1311a service nova] Creating event network-vif-plugged:218d229b-a7e5-4c33-9723-c6215e47e600 for instance aa81794d-bc81-49d2-b4dc-6f57b43ecfe8 on hv-cinder-84623 Jun 16 23:06:03.566355 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [req-0b695689-16aa-414e-85d0-2e3eb100a743 req-3b0becc4-7742-4027-b4d5-75562cf1311a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051521 Jun 16 23:06:03.567243 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 375/741] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 23:06:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 23:06:04.339176 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-2d74c19c-fd9e-4af7-b1bd-f8a308a4a22d tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:06:04.339812 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-2d74c19c-fd9e-4af7-b1bd-f8a308a4a22d tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] [instance: b7619c39-737f-440b-b676-8e920380d6c6] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:06:04.352851 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-2d74c19c-fd9e-4af7-b1bd-f8a308a4a22d tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:04.353562 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-2d74c19c-fd9e-4af7-b1bd-f8a308a4a22d tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:04.354329 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-2d74c19c-fd9e-4af7-b1bd-f8a308a4a22d tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:04.354841 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-2d74c19c-fd9e-4af7-b1bd-f8a308a4a22d tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:04.504316 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-2d74c19c-fd9e-4af7-b1bd-f8a308a4a22d tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a993f5d14b64fccad723abecfcadf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b1be8431b0434d8bd6abca293127d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:06:04.511688 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-2d74c19c-fd9e-4af7-b1bd-f8a308a4a22d tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] 10.222.0.17 "GET /compute/v2.1/servers/b7619c39-737f-440b-b676-8e920380d6c6" status: 200 len: 1548 microversion: 2.1 time: 0.176337 Jun 16 23:06:04.512250 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 367/742] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:06:04 2022] GET /compute/v2.1/servers/b7619c39-737f-440b-b676-8e920380d6c6 => generated 1548 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:06:04.529731 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-5ae21ed7-b40e-40f0-852f-4189c4c95a51 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:06:04.530314 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-5ae21ed7-b40e-40f0-852f-4189c4c95a51 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] [instance: b7619c39-737f-440b-b676-8e920380d6c6] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:06:04.537525 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-5ae21ed7-b40e-40f0-852f-4189c4c95a51 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:04.537972 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-5ae21ed7-b40e-40f0-852f-4189c4c95a51 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:04.538764 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-5ae21ed7-b40e-40f0-852f-4189c4c95a51 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:04.539199 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-5ae21ed7-b40e-40f0-852f-4189c4c95a51 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:04.626810 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-5ae21ed7-b40e-40f0-852f-4189c4c95a51 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] 10.222.0.17 "GET /compute/v2.1/servers/b7619c39-737f-440b-b676-8e920380d6c6/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.101744 Jun 16 23:06:04.627496 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 376/743] 10.222.0.17 () {58 vars in 1274 bytes} [Thu Jun 16 23:06:04 2022] GET /compute/v2.1/servers/b7619c39-737f-440b-b676-8e920380d6c6/os-interface => generated 284 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 23:06:05.881769 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [req-b0ddb47f-4445-4715-aaf1-44c11d908ce5 req-702354d4-8d6f-4758-82d8-9cdc3a715b55 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7619c39-737f-440b-b676-8e920380d6c6", "tag": "f3bd5725-2a88-4068-b338-b761ad56e180"}]} {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 23:06:05.891763 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-b0ddb47f-4445-4715-aaf1-44c11d908ce5 req-702354d4-8d6f-4758-82d8-9cdc3a715b55 service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:05.892438 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-b0ddb47f-4445-4715-aaf1-44c11d908ce5 req-702354d4-8d6f-4758-82d8-9cdc3a715b55 service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:05.916228 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.compute.server_external_events [req-b0ddb47f-4445-4715-aaf1-44c11d908ce5 req-702354d4-8d6f-4758-82d8-9cdc3a715b55 service nova] Creating event network-changed:f3bd5725-2a88-4068-b338-b761ad56e180 for instance b7619c39-737f-440b-b676-8e920380d6c6 on hv-cinder-84623 Jun 16 23:06:05.921918 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [req-b0ddb47f-4445-4715-aaf1-44c11d908ce5 req-702354d4-8d6f-4758-82d8-9cdc3a715b55 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043479 Jun 16 23:06:05.922537 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 368/744] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 23:06:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 23:06:06.824241 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-b2897592-8e15-4cb8-9f2f-29d9679b4970 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:06:06.824756 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-b2897592-8e15-4cb8-9f2f-29d9679b4970 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:06:06.831663 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-b2897592-8e15-4cb8-9f2f-29d9679b4970 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:06.832382 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-b2897592-8e15-4cb8-9f2f-29d9679b4970 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:06.833163 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-b2897592-8e15-4cb8-9f2f-29d9679b4970 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:06.833611 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-b2897592-8e15-4cb8-9f2f-29d9679b4970 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:06.858243 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-b2897592-8e15-4cb8-9f2f-29d9679b4970 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "GET /compute/v2.1/servers/88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda/ips" status: 200 len: 152 microversion: 2.20 time: 0.249916 Jun 16 23:06:06.858948 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 377/745] 10.222.0.17 () {60 vars in 1288 bytes} [Thu Jun 16 23:06:06 2022] GET /compute/v2.1/servers/88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda/ips => generated 152 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 16 23:06:08.377962 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-bcaaaa78-0d4a-4319-9a2b-a6155dc79b0b tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b22cc136-ffa1-4c00-ad99-9ec540914873"}} {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 23:06:08.379171 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-bcaaaa78-0d4a-4319-9a2b-a6155dc79b0b tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] [instance: 30b2118a-225b-457b-a15d-cf7656c69331] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:06:08.381636 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG dbcounter [-] [117563] Writing DB stats nova_cell0:SELECT=4 {{(pid=117563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 23:06:08.388111 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-bcaaaa78-0d4a-4319-9a2b-a6155dc79b0b tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:08.388621 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-bcaaaa78-0d4a-4319-9a2b-a6155dc79b0b tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:08.389400 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-bcaaaa78-0d4a-4319-9a2b-a6155dc79b0b tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:08.389838 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-bcaaaa78-0d4a-4319-9a2b-a6155dc79b0b tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:08.394102 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG dbcounter [-] [117563] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 23:06:08.477894 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.wsgi [None req-bcaaaa78-0d4a-4319-9a2b-a6155dc79b0b tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] HTTP exception thrown: Invalid volume: volume b22cc136-ffa1-4c00-ad99-9ec540914873 is already attached to instances: 30b2118a-225b-457b-a15d-cf7656c69331 Jun 16 23:06:08.479643 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-bcaaaa78-0d4a-4319-9a2b-a6155dc79b0b tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Request method failure captured: Jun 16 23:06:08.479643 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: request: POST /compute/v2.1/servers/30b2118a-225b-457b-a15d-cf7656c69331/os-volume_attachments HTTP/1.1 Jun 16 23:06:08.479643 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Accept: application/json Jun 16 23:06:08.479643 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Accept-Encoding: identity Jun 16 23:06:08.479643 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Connection: close Jun 16 23:06:08.479643 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Content-Length: 74 Jun 16 23:06:08.479643 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Content-Type: application/json Jun 16 23:06:08.479643 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Host: 10.222.0.17 Jun 16 23:06:08.479643 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Openstack-System-Scope: None Jun 16 23:06:08.479643 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: User-Agent: python-urllib3/1.26.9 Jun 16 23:06:08.479643 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Auth-Token: gAAAAABiq7YeRQnlz8l2GSIF0VOET6Y1W8yBB5oz1cYYpYFcfT7cYY0kIvo4O2qRVrDvagXVbkghr-k-KGb8GCGo_mbQOK1vAXciruDemULKCP_QAI9xPZafRW81TxgAIAvJEx6CPJUGbCIq4SyYsx25OB1SZXBFh8aRZWpbG6CQ65KEZvQlgIo Jun 16 23:06:08.479643 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Domain-Id: None Jun 16 23:06:08.479643 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Domain-Name: None Jun 16 23:06:08.479643 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Identity-Status: Confirmed Jun 16 23:06:08.479643 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Is-Admin-Project: True Jun 16 23:06:08.479643 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Project-Domain-Id: default Jun 16 23:06:08.479643 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Project-Domain-Name: Default Jun 16 23:06:08.479643 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Project-Id: 0526c12e8bc947209e24daf5ddfad7be Jun 16 23:06:08.479643 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Project-Name: tempest-AttachVolumeNegativeTest-1967724585 Jun 16 23:06:08.479643 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Role: member,reader Jun 16 23:06:08.479643 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Roles: member,reader Jun 16 23:06:08.481024 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/0526c12e8bc947209e24daf5ddfad7be"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_0526c12e8bc947209e24daf5ddfad7be"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0526c12e8bc947209e24daf5ddfad7be"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0526c12e8bc947209e24daf5ddfad7be"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Jun 16 23:06:08.481024 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Tenant: tempest-AttachVolumeNegativeTest-1967724585 Jun 16 23:06:08.481024 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Tenant-Id: 0526c12e8bc947209e24daf5ddfad7be Jun 16 23:06:08.481024 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1967724585 Jun 16 23:06:08.481024 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-User: tempest-AttachVolumeNegativeTest-1967724585-project Jun 16 23:06:08.481024 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-User-Domain-Id: default Jun 16 23:06:08.481024 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-User-Domain-Name: Default Jun 16 23:06:08.481024 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-User-Id: 9e3a2d16133b4af8a208682de8a7d111 Jun 16 23:06:08.481024 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-User-Name: tempest-AttachVolumeNegativeTest-1967724585-project Jun 16 23:06:08.481024 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Jun 16 23:06:08.481024 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: {"volumeAttachment": {"volumeId": "b22cc136-ffa1-4c00-ad99-9ec540914873"}} Jun 16 23:06:08.481024 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: method: > Jun 16 23:06:08.481820 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: exception: Invalid volume: volume b22cc136-ffa1-4c00-ad99-9ec540914873 is already attached to instances: 30b2118a-225b-457b-a15d-cf7656c69331 Jun 16 23:06:08.481820 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: action_args: {'server_id': '30b2118a-225b-457b-a15d-cf7656c69331', 'body': {'volumeAttachment': {'volumeId': 'b22cc136-ffa1-4c00-ad99-9ec540914873'}}} Jun 16 23:06:08.481820 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 23:06:08.481820 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 23:06:08.481820 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 16 23:06:08.481820 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 16 23:06:08.481820 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 16 23:06:08.481820 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 16 23:06:08.481820 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 16 23:06:08.481820 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 16 23:06:08.481820 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 16 23:06:08.481820 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 16 23:06:08.481820 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 16 23:06:08.481820 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 16 23:06:08.481820 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume b22cc136-ffa1-4c00-ad99-9ec540914873 is already attached to instances: 30b2118a-225b-457b-a15d-cf7656c69331 Jun 16 23:06:08.481820 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 16 23:06:08.481820 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 23:06:08.481820 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 16 23:06:08.481820 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 23:06:08.483459 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 23:06:08.483459 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 23:06:08.483459 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 23:06:08.483459 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 23:06:08.483459 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 23:06:08.483459 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 23:06:08.483459 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 23:06:08.483459 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 23:06:08.483459 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 23:06:08.483459 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 23:06:08.483459 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 23:06:08.483459 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 23:06:08.483459 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 16 23:06:08.483459 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 16 23:06:08.483459 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume b22cc136-ffa1-4c00-ad99-9ec540914873 is already attached to instances: 30b2118a-225b-457b-a15d-cf7656c69331 Jun 16 23:06:08.483459 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 16 23:06:08.483459 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 23:06:08.483459 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 16 23:06:08.483459 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 23:06:08.483459 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 23:06:08.485175 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 23:06:08.485175 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 23:06:08.485175 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 23:06:08.485175 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume b22cc136-ffa1-4c00-ad99-9ec540914873 is already attached to instances: 30b2118a-225b-457b-a15d-cf7656c69331 Jun 16 23:06:08.485175 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 16 23:06:08.485175 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-bcaaaa78-0d4a-4319-9a2b-a6155dc79b0b tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Returning 400 to user: Invalid volume: volume b22cc136-ffa1-4c00-ad99-9ec540914873 is already attached to instances: 30b2118a-225b-457b-a15d-cf7656c69331 {{(pid=117563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 23:06:08.485175 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-bcaaaa78-0d4a-4319-9a2b-a6155dc79b0b tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] 10.222.0.17 "POST /compute/v2.1/servers/30b2118a-225b-457b-a15d-cf7656c69331/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.107989 Jun 16 23:06:08.485175 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 369/746] 10.222.0.17 () {60 vars in 1322 bytes} [Thu Jun 16 23:06:08 2022] POST /compute/v2.1/servers/30b2118a-225b-457b-a15d-cf7656c69331/os-volume_attachments => generated 174 bytes in 109 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 16 23:06:08.545101 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-40818746-aadc-450c-b33e-61bb4d66ec47 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:06:08.545637 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-40818746-aadc-450c-b33e-61bb4d66ec47 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] [instance: 30b2118a-225b-457b-a15d-cf7656c69331] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:06:08.552986 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-40818746-aadc-450c-b33e-61bb4d66ec47 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:08.553486 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-40818746-aadc-450c-b33e-61bb4d66ec47 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:08.554278 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-40818746-aadc-450c-b33e-61bb4d66ec47 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:08.554903 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-40818746-aadc-450c-b33e-61bb4d66ec47 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:08.647440 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.objects.instance [None req-40818746-aadc-450c-b33e-61bb4d66ec47 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lazy-loading 'services' on Instance uuid 30b2118a-225b-457b-a15d-cf7656c69331 {{(pid=117562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 23:06:08.714807 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-9301ea1d-afcf-4fab-8a18-691e68beab72 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 23:06:08.715710 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-9301ea1d-afcf-4fab-8a18-691e68beab72 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:06:08.723271 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-9301ea1d-afcf-4fab-8a18-691e68beab72 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:08.724010 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-9301ea1d-afcf-4fab-8a18-691e68beab72 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:08.724862 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-9301ea1d-afcf-4fab-8a18-691e68beab72 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:08.725403 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-9301ea1d-afcf-4fab-8a18-691e68beab72 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:08.736840 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-40818746-aadc-450c-b33e-61bb4d66ec47 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] 10.222.0.17 "DELETE /compute/v2.1/servers/30b2118a-225b-457b-a15d-cf7656c69331/os-volume_attachments/b22cc136-ffa1-4c00-ad99-9ec540914873" status: 202 len: 0 microversion: 2.1 time: 0.194220 Jun 16 23:06:08.744395 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 378/747] 10.222.0.17 () {58 vars in 1415 bytes} [Thu Jun 16 23:06:08 2022] DELETE /compute/v2.1/servers/30b2118a-225b-457b-a15d-cf7656c69331/os-volume_attachments/b22cc136-ffa1-4c00-ad99-9ec540914873 => generated 0 bytes in 204 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 23:06:08.754109 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-043b9764-f9a7-4105-bbdd-74a8ec24fe6f tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:06:08.755657 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-043b9764-f9a7-4105-bbdd-74a8ec24fe6f tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] [instance: 30b2118a-225b-457b-a15d-cf7656c69331] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:06:08.761370 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.objects.instance [None req-9301ea1d-afcf-4fab-8a18-691e68beab72 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lazy-loading 'flavor' on Instance uuid 88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda {{(pid=117563) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 23:06:08.762614 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-043b9764-f9a7-4105-bbdd-74a8ec24fe6f tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:08.763081 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-043b9764-f9a7-4105-bbdd-74a8ec24fe6f tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:08.763862 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-043b9764-f9a7-4105-bbdd-74a8ec24fe6f tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:08.764495 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-043b9764-f9a7-4105-bbdd-74a8ec24fe6f tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:08.799565 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-043b9764-f9a7-4105-bbdd-74a8ec24fe6f tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] 10.222.0.17 "GET /compute/v2.1/servers/30b2118a-225b-457b-a15d-cf7656c69331/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050775 Jun 16 23:06:08.804673 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 379/748] 10.222.0.17 () {58 vars in 1301 bytes} [Thu Jun 16 23:06:08 2022] GET /compute/v2.1/servers/30b2118a-225b-457b-a15d-cf7656c69331/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 23:06:09.087240 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-9301ea1d-afcf-4fab-8a18-691e68beab72 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "POST /compute/v2.1/servers/88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda/action" status: 202 len: 0 microversion: 2.20 time: 0.376277 Jun 16 23:06:09.088204 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 370/749] 10.222.0.17 () {62 vars in 1318 bytes} [Thu Jun 16 23:06:08 2022] POST /compute/v2.1/servers/88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda/action => generated 0 bytes in 378 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jun 16 23:06:09.096711 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-808039e4-8576-4b11-ab00-1a4a197f2e15 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:06:09.097639 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-808039e4-8576-4b11-ab00-1a4a197f2e15 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:06:09.104021 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-808039e4-8576-4b11-ab00-1a4a197f2e15 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:09.104478 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-808039e4-8576-4b11-ab00-1a4a197f2e15 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:09.105265 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-808039e4-8576-4b11-ab00-1a4a197f2e15 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:09.105707 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-808039e4-8576-4b11-ab00-1a4a197f2e15 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:09.262101 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-808039e4-8576-4b11-ab00-1a4a197f2e15 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:06:09.270605 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-808039e4-8576-4b11-ab00-1a4a197f2e15 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:06:09.272143 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-808039e4-8576-4b11-ab00-1a4a197f2e15 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:06:09.273317 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-808039e4-8576-4b11-ab00-1a4a197f2e15 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "GET /compute/v2.1/servers/88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda" status: 200 len: 1724 microversion: 2.20 time: 0.180640 Jun 16 23:06:09.284970 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 380/750] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 23:06:09 2022] GET /compute/v2.1/servers/88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda => generated 1724 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 23:06:09.812497 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-ab70f454-9d18-44d4-81aa-41498c757b0b tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:06:09.813491 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-ab70f454-9d18-44d4-81aa-41498c757b0b tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] [instance: 30b2118a-225b-457b-a15d-cf7656c69331] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:06:09.820241 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-ab70f454-9d18-44d4-81aa-41498c757b0b tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:09.820684 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-ab70f454-9d18-44d4-81aa-41498c757b0b tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:09.821639 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-ab70f454-9d18-44d4-81aa-41498c757b0b tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:09.822239 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-ab70f454-9d18-44d4-81aa-41498c757b0b tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:09.860226 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-ab70f454-9d18-44d4-81aa-41498c757b0b tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] 10.222.0.17 "GET /compute/v2.1/servers/30b2118a-225b-457b-a15d-cf7656c69331/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052370 Jun 16 23:06:09.865507 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 371/751] 10.222.0.17 () {58 vars in 1301 bytes} [Thu Jun 16 23:06:09 2022] GET /compute/v2.1/servers/30b2118a-225b-457b-a15d-cf7656c69331/os-volume_attachments => generated 25 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 23:06:09.932542 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-9a4b2300-c0b9-406d-853a-586261357576 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:06:09.933082 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-9a4b2300-c0b9-406d-853a-586261357576 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] [instance: 30b2118a-225b-457b-a15d-cf7656c69331] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:06:09.939976 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-9a4b2300-c0b9-406d-853a-586261357576 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:09.940429 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-9a4b2300-c0b9-406d-853a-586261357576 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:09.941195 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-9a4b2300-c0b9-406d-853a-586261357576 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:09.941630 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-9a4b2300-c0b9-406d-853a-586261357576 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:09.957307 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG dbcounter [-] [117562] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 23:06:09.969024 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-9a4b2300-c0b9-406d-853a-586261357576 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] [instance: 30b2118a-225b-457b-a15d-cf7656c69331] Going to try to terminate instance {{(pid=117562) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 23:06:10.047579 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-9a4b2300-c0b9-406d-853a-586261357576 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] 10.222.0.17 "DELETE /compute/v2.1/servers/30b2118a-225b-457b-a15d-cf7656c69331" status: 204 len: 0 microversion: 2.1 time: 0.118531 Jun 16 23:06:10.048360 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 381/752] 10.222.0.17 () {58 vars in 1238 bytes} [Thu Jun 16 23:06:09 2022] DELETE /compute/v2.1/servers/30b2118a-225b-457b-a15d-cf7656c69331 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 23:06:10.057561 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-d275f1b6-b9e8-42fc-b4ee-57c8357f1972 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:06:10.058458 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-d275f1b6-b9e8-42fc-b4ee-57c8357f1972 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] [instance: 30b2118a-225b-457b-a15d-cf7656c69331] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:06:10.065612 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-d275f1b6-b9e8-42fc-b4ee-57c8357f1972 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:10.066060 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-d275f1b6-b9e8-42fc-b4ee-57c8357f1972 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:10.066881 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-d275f1b6-b9e8-42fc-b4ee-57c8357f1972 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:10.067513 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-d275f1b6-b9e8-42fc-b4ee-57c8357f1972 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:10.214768 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-d275f1b6-b9e8-42fc-b4ee-57c8357f1972 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3a2d16133b4af8a208682de8a7d111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0526c12e8bc947209e24daf5ddfad7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:06:10.222769 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-d275f1b6-b9e8-42fc-b4ee-57c8357f1972 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] 10.222.0.17 "GET /compute/v2.1/servers/30b2118a-225b-457b-a15d-cf7656c69331" status: 200 len: 1680 microversion: 2.1 time: 0.169701 Jun 16 23:06:10.223332 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 372/753] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:06:10 2022] GET /compute/v2.1/servers/30b2118a-225b-457b-a15d-cf7656c69331 => generated 1680 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:06:10.292877 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-70437bdc-f6a1-45cc-a3cf-58a9496f0914 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:06:10.293438 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-70437bdc-f6a1-45cc-a3cf-58a9496f0914 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:06:10.299486 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-70437bdc-f6a1-45cc-a3cf-58a9496f0914 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:10.300039 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-70437bdc-f6a1-45cc-a3cf-58a9496f0914 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:10.300698 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-70437bdc-f6a1-45cc-a3cf-58a9496f0914 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:10.301130 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-70437bdc-f6a1-45cc-a3cf-58a9496f0914 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:10.436888 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-70437bdc-f6a1-45cc-a3cf-58a9496f0914 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:06:10.444772 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-70437bdc-f6a1-45cc-a3cf-58a9496f0914 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:06:10.446298 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-70437bdc-f6a1-45cc-a3cf-58a9496f0914 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:06:10.447495 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-70437bdc-f6a1-45cc-a3cf-58a9496f0914 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "GET /compute/v2.1/servers/88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda" status: 200 len: 1724 microversion: 2.20 time: 0.158923 Jun 16 23:06:10.448059 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 382/754] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 23:06:10 2022] GET /compute/v2.1/servers/88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 23:06:11.239998 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-a5e355cc-f386-4e4f-9544-ec8be5a8a460 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:06:11.240669 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-a5e355cc-f386-4e4f-9544-ec8be5a8a460 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] [instance: 30b2118a-225b-457b-a15d-cf7656c69331] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:06:11.247522 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-a5e355cc-f386-4e4f-9544-ec8be5a8a460 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:11.248106 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-a5e355cc-f386-4e4f-9544-ec8be5a8a460 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:11.248997 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-a5e355cc-f386-4e4f-9544-ec8be5a8a460 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:11.252983 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-a5e355cc-f386-4e4f-9544-ec8be5a8a460 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:11.395903 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-a5e355cc-f386-4e4f-9544-ec8be5a8a460 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3a2d16133b4af8a208682de8a7d111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0526c12e8bc947209e24daf5ddfad7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:06:11.403214 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-a5e355cc-f386-4e4f-9544-ec8be5a8a460 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] 10.222.0.17 "GET /compute/v2.1/servers/30b2118a-225b-457b-a15d-cf7656c69331" status: 200 len: 1680 microversion: 2.1 time: 0.167166 Jun 16 23:06:11.403774 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 373/755] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:06:11 2022] GET /compute/v2.1/servers/30b2118a-225b-457b-a15d-cf7656c69331 => generated 1680 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:06:11.467271 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-54300b61-dfcd-4d95-8a6e-aa1f85806879 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:06:11.467878 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-54300b61-dfcd-4d95-8a6e-aa1f85806879 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:06:11.474381 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-54300b61-dfcd-4d95-8a6e-aa1f85806879 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:11.474862 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-54300b61-dfcd-4d95-8a6e-aa1f85806879 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:11.475808 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-54300b61-dfcd-4d95-8a6e-aa1f85806879 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:11.476243 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-54300b61-dfcd-4d95-8a6e-aa1f85806879 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:11.615063 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-54300b61-dfcd-4d95-8a6e-aa1f85806879 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:06:11.623312 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-54300b61-dfcd-4d95-8a6e-aa1f85806879 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:06:11.625305 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-54300b61-dfcd-4d95-8a6e-aa1f85806879 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:06:11.626293 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-54300b61-dfcd-4d95-8a6e-aa1f85806879 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "GET /compute/v2.1/servers/88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda" status: 200 len: 1724 microversion: 2.20 time: 0.163906 Jun 16 23:06:11.627806 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 383/756] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 23:06:11 2022] GET /compute/v2.1/servers/88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 23:06:12.421574 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-42bd81e8-8841-45a9-ae2f-58cc303373b2 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:06:12.422340 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-42bd81e8-8841-45a9-ae2f-58cc303373b2 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] [instance: 30b2118a-225b-457b-a15d-cf7656c69331] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:06:12.430076 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-42bd81e8-8841-45a9-ae2f-58cc303373b2 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:12.430623 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-42bd81e8-8841-45a9-ae2f-58cc303373b2 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:12.431476 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-42bd81e8-8841-45a9-ae2f-58cc303373b2 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:12.431993 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-42bd81e8-8841-45a9-ae2f-58cc303373b2 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:12.644955 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-5b11702c-6959-40fd-bd75-14394c03ab06 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:06:12.645485 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-5b11702c-6959-40fd-bd75-14394c03ab06 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:06:12.647939 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG dbcounter [-] [117562] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=1,nova_api:INSERT=1,nova_api:UPDATE=2 {{(pid=117562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 23:06:12.653253 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-5b11702c-6959-40fd-bd75-14394c03ab06 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:12.653695 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-5b11702c-6959-40fd-bd75-14394c03ab06 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:12.654474 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-5b11702c-6959-40fd-bd75-14394c03ab06 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:12.654915 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-5b11702c-6959-40fd-bd75-14394c03ab06 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:12.711660 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-42bd81e8-8841-45a9-ae2f-58cc303373b2 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3a2d16133b4af8a208682de8a7d111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0526c12e8bc947209e24daf5ddfad7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:06:12.719606 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-42bd81e8-8841-45a9-ae2f-58cc303373b2 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] 10.222.0.17 "GET /compute/v2.1/servers/30b2118a-225b-457b-a15d-cf7656c69331" status: 200 len: 1680 microversion: 2.1 time: 0.302514 Jun 16 23:06:12.720290 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 374/757] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:06:12 2022] GET /compute/v2.1/servers/30b2118a-225b-457b-a15d-cf7656c69331 => generated 1680 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:06:12.928200 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-5b11702c-6959-40fd-bd75-14394c03ab06 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:06:12.937046 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-5b11702c-6959-40fd-bd75-14394c03ab06 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:06:12.938931 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-5b11702c-6959-40fd-bd75-14394c03ab06 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:06:12.941300 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-5b11702c-6959-40fd-bd75-14394c03ab06 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "GET /compute/v2.1/servers/88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda" status: 200 len: 1724 microversion: 2.20 time: 0.300391 Jun 16 23:06:12.952359 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 384/758] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 23:06:12 2022] GET /compute/v2.1/servers/88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda => generated 1724 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 23:06:13.344892 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [req-240de487-53a6-4063-bd23-37695ab44575 req-35a7ad10-9d2f-4710-b737-a7a69aefd5d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30b2118a-225b-457b-a15d-cf7656c69331", "name": "network-vif-deleted", "tag": "64041190-c0ec-441a-a5bb-be754b053d2d"}]} {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 23:06:13.354159 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-240de487-53a6-4063-bd23-37695ab44575 req-35a7ad10-9d2f-4710-b737-a7a69aefd5d1 service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:13.354834 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-240de487-53a6-4063-bd23-37695ab44575 req-35a7ad10-9d2f-4710-b737-a7a69aefd5d1 service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:13.366584 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.compute.server_external_events [req-240de487-53a6-4063-bd23-37695ab44575 req-35a7ad10-9d2f-4710-b737-a7a69aefd5d1 service nova] Creating event network-vif-deleted:64041190-c0ec-441a-a5bb-be754b053d2d for instance 30b2118a-225b-457b-a15d-cf7656c69331 on hv-cinder-84623 Jun 16 23:06:13.371999 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [req-240de487-53a6-4063-bd23-37695ab44575 req-35a7ad10-9d2f-4710-b737-a7a69aefd5d1 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.313278 Jun 16 23:06:13.372638 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 375/759] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 23:06:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 23:06:13.737729 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-0bed2bb9-73e6-40e4-a28e-01d6b1c683f8 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:06:13.738449 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-0bed2bb9-73e6-40e4-a28e-01d6b1c683f8 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] [instance: 30b2118a-225b-457b-a15d-cf7656c69331] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:06:13.744797 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-0bed2bb9-73e6-40e4-a28e-01d6b1c683f8 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:13.745405 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-0bed2bb9-73e6-40e4-a28e-01d6b1c683f8 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:13.746272 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-0bed2bb9-73e6-40e4-a28e-01d6b1c683f8 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:13.746837 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-0bed2bb9-73e6-40e4-a28e-01d6b1c683f8 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:13.761520 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.wsgi [None req-0bed2bb9-73e6-40e4-a28e-01d6b1c683f8 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] HTTP exception thrown: Instance 30b2118a-225b-457b-a15d-cf7656c69331 could not be found. Jun 16 23:06:13.763476 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-0bed2bb9-73e6-40e4-a28e-01d6b1c683f8 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Request method failure captured: Jun 16 23:06:13.763476 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: request: GET /compute/v2.1/servers/30b2118a-225b-457b-a15d-cf7656c69331 HTTP/1.1 Jun 16 23:06:13.763476 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Accept: application/json Jun 16 23:06:13.763476 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Accept-Encoding: identity Jun 16 23:06:13.763476 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Connection: close Jun 16 23:06:13.763476 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Content-Length: 0 Jun 16 23:06:13.763476 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Content-Type: application/json Jun 16 23:06:13.763476 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Host: 10.222.0.17 Jun 16 23:06:13.763476 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Openstack-System-Scope: None Jun 16 23:06:13.763476 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: User-Agent: python-urllib3/1.26.9 Jun 16 23:06:13.763476 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Auth-Token: gAAAAABiq7YeRQnlz8l2GSIF0VOET6Y1W8yBB5oz1cYYpYFcfT7cYY0kIvo4O2qRVrDvagXVbkghr-k-KGb8GCGo_mbQOK1vAXciruDemULKCP_QAI9xPZafRW81TxgAIAvJEx6CPJUGbCIq4SyYsx25OB1SZXBFh8aRZWpbG6CQ65KEZvQlgIo Jun 16 23:06:13.763476 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Domain-Id: None Jun 16 23:06:13.763476 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Domain-Name: None Jun 16 23:06:13.763476 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Identity-Status: Confirmed Jun 16 23:06:13.763476 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Is-Admin-Project: True Jun 16 23:06:13.763476 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Project-Domain-Id: default Jun 16 23:06:13.763476 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Project-Domain-Name: Default Jun 16 23:06:13.763476 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Project-Id: 0526c12e8bc947209e24daf5ddfad7be Jun 16 23:06:13.763476 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Project-Name: tempest-AttachVolumeNegativeTest-1967724585 Jun 16 23:06:13.763476 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Role: member,reader Jun 16 23:06:13.763476 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Roles: member,reader Jun 16 23:06:13.765044 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/0526c12e8bc947209e24daf5ddfad7be"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_0526c12e8bc947209e24daf5ddfad7be"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0526c12e8bc947209e24daf5ddfad7be"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0526c12e8bc947209e24daf5ddfad7be"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Jun 16 23:06:13.765044 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Tenant: tempest-AttachVolumeNegativeTest-1967724585 Jun 16 23:06:13.765044 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Tenant-Id: 0526c12e8bc947209e24daf5ddfad7be Jun 16 23:06:13.765044 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1967724585 Jun 16 23:06:13.765044 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-User: tempest-AttachVolumeNegativeTest-1967724585-project Jun 16 23:06:13.765044 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-User-Domain-Id: default Jun 16 23:06:13.765044 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-User-Domain-Name: Default Jun 16 23:06:13.765044 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-User-Id: 9e3a2d16133b4af8a208682de8a7d111 Jun 16 23:06:13.765044 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-User-Name: tempest-AttachVolumeNegativeTest-1967724585-project Jun 16 23:06:13.765044 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: method: > Jun 16 23:06:13.765044 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: exception: Instance 30b2118a-225b-457b-a15d-cf7656c69331 could not be found. Jun 16 23:06:13.765044 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: action_args: {'id': '30b2118a-225b-457b-a15d-cf7656c69331'} Jun 16 23:06:13.765857 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 23:06:13.765857 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 23:06:13.765857 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 23:06:13.765857 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 23:06:13.765857 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 23:06:13.765857 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 23:06:13.765857 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 23:06:13.765857 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 23:06:13.765857 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 23:06:13.765857 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 23:06:13.765857 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 30b2118a-225b-457b-a15d-cf7656c69331 could not be found. Jun 16 23:06:13.765857 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Jun 16 23:06:13.765857 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 23:06:13.765857 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Jun 16 23:06:13.765857 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 23:06:13.765857 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 23:06:13.765857 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 23:06:13.765857 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 23:06:13.765857 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 23:06:13.765857 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 23:06:13.767214 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 23:06:13.767214 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 23:06:13.767214 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 23:06:13.767214 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 23:06:13.767214 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 23:06:13.767214 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 23:06:13.767214 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 23:06:13.767214 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30b2118a-225b-457b-a15d-cf7656c69331 could not be found. Jun 16 23:06:13.767214 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Jun 16 23:06:13.767214 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 23:06:13.767214 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Jun 16 23:06:13.767214 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 23:06:13.767214 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 23:06:13.767214 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 23:06:13.767214 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 23:06:13.767214 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 23:06:13.767214 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30b2118a-225b-457b-a15d-cf7656c69331 could not be found. Jun 16 23:06:13.767214 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Jun 16 23:06:13.768556 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-0bed2bb9-73e6-40e4-a28e-01d6b1c683f8 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Returning 404 to user: Instance 30b2118a-225b-457b-a15d-cf7656c69331 could not be found. {{(pid=117562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 23:06:13.768556 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-0bed2bb9-73e6-40e4-a28e-01d6b1c683f8 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] 10.222.0.17 "GET /compute/v2.1/servers/30b2118a-225b-457b-a15d-cf7656c69331" status: 404 len: 111 microversion: 2.1 time: 0.032014 Jun 16 23:06:13.768556 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 385/760] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:06:13 2022] GET /compute/v2.1/servers/30b2118a-225b-457b-a15d-cf7656c69331 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 23:06:13.775238 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-bb355d8d-4038-4350-a852-ea641146a6a2 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Calling method '.version_select at 0x7f531354c790>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:06:13.781668 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG dbcounter [-] [117563] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=4 {{(pid=117563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 23:06:13.800215 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-bb355d8d-4038-4350-a852-ea641146a6a2 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-226223852" status: 202 len: 0 microversion: 2.1 time: 0.029659 Jun 16 23:06:13.800798 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 376/761] 10.222.0.17 () {58 vars in 1217 bytes} [Thu Jun 16 23:06:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-226223852 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 23:06:13.961641 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-f9aff6f1-9945-4673-bd99-10e34e60b82e tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:06:13.962332 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-f9aff6f1-9945-4673-bd99-10e34e60b82e tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:06:13.971151 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-f9aff6f1-9945-4673-bd99-10e34e60b82e tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:13.971883 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-f9aff6f1-9945-4673-bd99-10e34e60b82e tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:13.972859 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-f9aff6f1-9945-4673-bd99-10e34e60b82e tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:13.973459 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-f9aff6f1-9945-4673-bd99-10e34e60b82e tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:14.213341 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-f9aff6f1-9945-4673-bd99-10e34e60b82e tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:06:14.230140 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-f9aff6f1-9945-4673-bd99-10e34e60b82e tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:06:14.233410 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-f9aff6f1-9945-4673-bd99-10e34e60b82e tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:06:14.234646 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-f9aff6f1-9945-4673-bd99-10e34e60b82e tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "GET /compute/v2.1/servers/88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda" status: 200 len: 1724 microversion: 2.20 time: 0.278605 Jun 16 23:06:14.236490 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 386/762] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 23:06:13 2022] GET /compute/v2.1/servers/88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda => generated 1724 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 23:06:14.543596 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-62d2149c-cce0-4987-a4b2-f37eb2e0cf25 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Action: 'create', calling method: .version_select at 0x7f53135b3d30>, body: {"keypair": {"name": "tempest-keypair-262034099", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNjaxCo8AyxuUf7+2qVprlL3NZaNDM3r9zTWX30RIkdRIEYZhGs4lcvMQs/mRsjzPPa57yCgBeD/PzOCBZhzNUxj0aL1ehzzM3oGjdO8LShHoQo2HOvnJ8/mG0U8ksCaXg=="}} {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 23:06:14.558220 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.quota [None req-62d2149c-cce0-4987-a4b2-f37eb2e0cf25 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Getting quotas for project 0526c12e8bc947209e24daf5ddfad7be. Resources: {'key_pairs'} {{(pid=117563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 23:06:14.562034 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.quota [None req-62d2149c-cce0-4987-a4b2-f37eb2e0cf25 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Getting quotas for user 9e3a2d16133b4af8a208682de8a7d111 and project 0526c12e8bc947209e24daf5ddfad7be. Resources: {'key_pairs'} {{(pid=117563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 23:06:14.585685 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-62d2149c-cce0-4987-a4b2-f37eb2e0cf25 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.045894 Jun 16 23:06:14.590565 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 377/763] 10.222.0.17 () {60 vars in 1158 bytes} [Thu Jun 16 23:06:14 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 23:06:15.253313 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-5a8c7c17-238d-4168-a0b7-96aa5d58f367 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:06:15.253897 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-5a8c7c17-238d-4168-a0b7-96aa5d58f367 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:06:15.260932 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-5a8c7c17-238d-4168-a0b7-96aa5d58f367 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:15.261381 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-5a8c7c17-238d-4168-a0b7-96aa5d58f367 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:15.262185 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-5a8c7c17-238d-4168-a0b7-96aa5d58f367 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:15.262642 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-5a8c7c17-238d-4168-a0b7-96aa5d58f367 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:15.424323 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-5a8c7c17-238d-4168-a0b7-96aa5d58f367 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:06:15.433006 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-5a8c7c17-238d-4168-a0b7-96aa5d58f367 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:06:15.435166 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-5a8c7c17-238d-4168-a0b7-96aa5d58f367 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:06:15.437016 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-5a8c7c17-238d-4168-a0b7-96aa5d58f367 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "GET /compute/v2.1/servers/88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda" status: 200 len: 1724 microversion: 2.20 time: 0.187051 Jun 16 23:06:15.438140 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 387/764] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 23:06:15 2022] GET /compute/v2.1/servers/88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda => generated 1724 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 23:06:15.904489 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-32b26eed-a4f9-4568-a91f-1926a5facf71 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1985328973", "imageRef": "2b486731-e5ea-4159-b6b1-ed0083e00543", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "663ca997-5122-4586-973b-ea2e3ed98672"}], "security_groups": [{"name": "tempest-securitygroup--1756991730"}], "key_name": "tempest-keypair-262034099", "user_data": "}} {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 23:06:16.021791 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.network.neutron [None req-32b26eed-a4f9-4568-a91f-1926a5facf71 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] validate_networks() for [('663ca997-5122-4586-973b-ea2e3ed98672', None, None, None, None, None)] {{(pid=117563) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 23:06:16.450493 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-a06bd784-857d-4da0-821d-dffba6d17c33 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-333071053", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1351668635", "security_groups": [{"name": "tempest-secgroup-smoke-307129787"}], "block_device_mapping_v2": [{"uuid": "805e4f35-50db-4b56-91e5-8b3bbbd395fe", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "b60aa0be-29dc-41f5-b1f9-8245b5200d1c"}]}} {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 23:06:16.507266 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.virt.hardware [None req-32b26eed-a4f9-4568-a91f-1926a5facf71 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Flavor limits 0:0:0 {{(pid=117563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 23:06:16.507815 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.virt.hardware [None req-32b26eed-a4f9-4568-a91f-1926a5facf71 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Image limits 0:0:0 {{(pid=117563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 23:06:16.508501 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.virt.hardware [None req-32b26eed-a4f9-4568-a91f-1926a5facf71 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Flavor pref 0:0:0 {{(pid=117563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 23:06:16.508904 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.virt.hardware [None req-32b26eed-a4f9-4568-a91f-1926a5facf71 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Image pref 0:0:0 {{(pid=117563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 23:06:16.509315 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.virt.hardware [None req-32b26eed-a4f9-4568-a91f-1926a5facf71 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 23:06:16.518556 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-32b26eed-a4f9-4568-a91f-1926a5facf71 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:16.519112 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-32b26eed-a4f9-4568-a91f-1926a5facf71 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:16.519963 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-32b26eed-a4f9-4568-a91f-1926a5facf71 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:16.520407 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-32b26eed-a4f9-4568-a91f-1926a5facf71 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:16.539026 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.quota [None req-32b26eed-a4f9-4568-a91f-1926a5facf71 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Getting quotas for project 0526c12e8bc947209e24daf5ddfad7be. Resources: {'instances', 'cores', 'ram'} {{(pid=117563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 23:06:16.543127 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.quota [None req-32b26eed-a4f9-4568-a91f-1926a5facf71 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Getting quotas for user 9e3a2d16133b4af8a208682de8a7d111 and project 0526c12e8bc947209e24daf5ddfad7be. Resources: {'instances', 'cores', 'ram'} {{(pid=117563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 23:06:16.554656 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-32b26eed-a4f9-4568-a91f-1926a5facf71 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Going to run 1 instances... {{(pid=117563) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 23:06:16.557045 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-32b26eed-a4f9-4568-a91f-1926a5facf71 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] [instance: 07404710-1539-46ee-b4ff-2ef30af07f8e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2b486731-e5ea-4159-b6b1-ed0083e00543',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117563) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 23:06:16.569597 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.network.neutron [None req-a06bd784-857d-4da0-821d-dffba6d17c33 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] validate_networks() for [('b60aa0be-29dc-41f5-b1f9-8245b5200d1c', None, None, None, None, None)] {{(pid=117562) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 23:06:16.604517 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-32b26eed-a4f9-4568-a91f-1926a5facf71 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.704786 Jun 16 23:06:16.605696 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 378/765] 10.222.0.17 () {60 vars in 1146 bytes} [Thu Jun 16 23:06:15 2022] POST /compute/v2.1/servers => generated 402 bytes in 706 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 23:06:16.609847 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-d33d8dca-6b58-40f6-a628-c241f8b06f23 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:06:16.611481 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-d33d8dca-6b58-40f6-a628-c241f8b06f23 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:06:16.617660 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-d33d8dca-6b58-40f6-a628-c241f8b06f23 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:16.618310 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-d33d8dca-6b58-40f6-a628-c241f8b06f23 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:16.618913 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-d33d8dca-6b58-40f6-a628-c241f8b06f23 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:16.619353 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-d33d8dca-6b58-40f6-a628-c241f8b06f23 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:16.820980 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-d33d8dca-6b58-40f6-a628-c241f8b06f23 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:06:16.829551 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-d33d8dca-6b58-40f6-a628-c241f8b06f23 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:06:16.831550 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-d33d8dca-6b58-40f6-a628-c241f8b06f23 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:06:16.832986 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-d33d8dca-6b58-40f6-a628-c241f8b06f23 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "GET /compute/v2.1/servers/88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda" status: 200 len: 1724 microversion: 2.20 time: 0.226647 Jun 16 23:06:16.833527 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 379/766] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 23:06:16 2022] GET /compute/v2.1/servers/88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda => generated 1724 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 23:06:16.840076 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-d679318f-fcd2-4c5f-9344-a33cf3062544 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:06:16.840897 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-d679318f-fcd2-4c5f-9344-a33cf3062544 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] [instance: 07404710-1539-46ee-b4ff-2ef30af07f8e] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:06:16.919910 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-d679318f-fcd2-4c5f-9344-a33cf3062544 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3a2d16133b4af8a208682de8a7d111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0526c12e8bc947209e24daf5ddfad7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:06:16.926684 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-d679318f-fcd2-4c5f-9344-a33cf3062544 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] 10.222.0.17 "GET /compute/v2.1/servers/07404710-1539-46ee-b4ff-2ef30af07f8e" status: 200 len: 1241 microversion: 2.1 time: 0.091903 Jun 16 23:06:16.927211 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 380/767] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:06:16 2022] GET /compute/v2.1/servers/07404710-1539-46ee-b4ff-2ef30af07f8e => generated 1241 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:06:17.111627 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.virt.hardware [None req-a06bd784-857d-4da0-821d-dffba6d17c33 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Flavor limits 0:0:0 {{(pid=117562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 23:06:17.112056 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.virt.hardware [None req-a06bd784-857d-4da0-821d-dffba6d17c33 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Image limits 0:0:0 {{(pid=117562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 23:06:17.112529 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.virt.hardware [None req-a06bd784-857d-4da0-821d-dffba6d17c33 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Flavor pref 0:0:0 {{(pid=117562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 23:06:17.112939 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.virt.hardware [None req-a06bd784-857d-4da0-821d-dffba6d17c33 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Image pref 0:0:0 {{(pid=117562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 23:06:17.113356 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.virt.hardware [None req-a06bd784-857d-4da0-821d-dffba6d17c33 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 23:06:17.124606 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-a06bd784-857d-4da0-821d-dffba6d17c33 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:17.125325 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-a06bd784-857d-4da0-821d-dffba6d17c33 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:17.126703 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-a06bd784-857d-4da0-821d-dffba6d17c33 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:17.127177 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-a06bd784-857d-4da0-821d-dffba6d17c33 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:17.145749 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.quota [None req-a06bd784-857d-4da0-821d-dffba6d17c33 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Getting quotas for project 1423c05c42b14519b401e22e16062781. Resources: {'instances', 'cores', 'ram'} {{(pid=117562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 23:06:17.149826 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.quota [None req-a06bd784-857d-4da0-821d-dffba6d17c33 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Getting quotas for user 2697aa77265e4f5783f87ffb3d4992b5 and project 1423c05c42b14519b401e22e16062781. Resources: {'instances', 'cores', 'ram'} {{(pid=117562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 23:06:17.214530 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-a06bd784-857d-4da0-821d-dffba6d17c33 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Going to run 1 instances... {{(pid=117562) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 23:06:17.216941 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-a06bd784-857d-4da0-821d-dffba6d17c33 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] [instance: bf5049e3-3446-468a-a334-d87825e50af4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='805e4f35-50db-4b56-91e5-8b3bbbd395fe',volume_size=None,volume_type=None)] {{(pid=117562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 23:06:17.393876 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-a06bd784-857d-4da0-821d-dffba6d17c33 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.948030 Jun 16 23:06:17.400284 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 388/768] 10.222.0.17 () {60 vars in 1146 bytes} [Thu Jun 16 23:06:16 2022] POST /compute/v2.1/servers => generated 405 bytes in 950 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 23:06:17.406994 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-d107a886-b040-4d47-b3a5-a576fde594ca tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:06:17.408258 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-d107a886-b040-4d47-b3a5-a576fde594ca tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] [instance: bf5049e3-3446-468a-a334-d87825e50af4] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:06:17.467776 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-d107a886-b040-4d47-b3a5-a576fde594ca tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2697aa77265e4f5783f87ffb3d4992b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1423c05c42b14519b401e22e16062781', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:06:17.476962 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-d107a886-b040-4d47-b3a5-a576fde594ca tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] 10.222.0.17 "GET /compute/v2.1/servers/bf5049e3-3446-468a-a334-d87825e50af4" status: 200 len: 1094 microversion: 2.1 time: 0.074128 Jun 16 23:06:17.478243 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 381/769] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:06:17 2022] GET /compute/v2.1/servers/bf5049e3-3446-468a-a334-d87825e50af4 => generated 1094 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:06:17.854057 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-5b533503-00a5-4e99-8152-c80440221501 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:06:17.854823 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-5b533503-00a5-4e99-8152-c80440221501 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:06:17.865153 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-5b533503-00a5-4e99-8152-c80440221501 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:17.865794 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-5b533503-00a5-4e99-8152-c80440221501 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:17.867704 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-5b533503-00a5-4e99-8152-c80440221501 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:17.868838 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-5b533503-00a5-4e99-8152-c80440221501 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:17.943779 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-291212df-3826-42ac-9412-f66fcef0f850 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:06:17.944431 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-291212df-3826-42ac-9412-f66fcef0f850 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] [instance: 07404710-1539-46ee-b4ff-2ef30af07f8e] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:06:17.951507 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-291212df-3826-42ac-9412-f66fcef0f850 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:17.951975 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-291212df-3826-42ac-9412-f66fcef0f850 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:17.952776 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-291212df-3826-42ac-9412-f66fcef0f850 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:17.953222 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-291212df-3826-42ac-9412-f66fcef0f850 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:18.100243 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-291212df-3826-42ac-9412-f66fcef0f850 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3a2d16133b4af8a208682de8a7d111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0526c12e8bc947209e24daf5ddfad7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:06:18.111552 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-291212df-3826-42ac-9412-f66fcef0f850 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] 10.222.0.17 "GET /compute/v2.1/servers/07404710-1539-46ee-b4ff-2ef30af07f8e" status: 200 len: 1299 microversion: 2.1 time: 0.171030 Jun 16 23:06:18.112365 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 382/770] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:06:17 2022] GET /compute/v2.1/servers/07404710-1539-46ee-b4ff-2ef30af07f8e => generated 1299 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 23:06:18.148692 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-5b533503-00a5-4e99-8152-c80440221501 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:06:18.159223 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-5b533503-00a5-4e99-8152-c80440221501 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:06:18.161043 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-5b533503-00a5-4e99-8152-c80440221501 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:06:18.162271 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-5b533503-00a5-4e99-8152-c80440221501 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "GET /compute/v2.1/servers/88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda" status: 200 len: 1724 microversion: 2.20 time: 0.312703 Jun 16 23:06:18.162897 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 389/771] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 23:06:17 2022] GET /compute/v2.1/servers/88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda => generated 1724 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 23:06:18.494739 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-3a0eaed3-6492-42f1-9e78-c8ee1f5fd37a tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:06:18.495361 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-3a0eaed3-6492-42f1-9e78-c8ee1f5fd37a tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] [instance: bf5049e3-3446-468a-a334-d87825e50af4] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:06:18.505193 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-3a0eaed3-6492-42f1-9e78-c8ee1f5fd37a tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:18.505649 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-3a0eaed3-6492-42f1-9e78-c8ee1f5fd37a tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:18.506484 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-3a0eaed3-6492-42f1-9e78-c8ee1f5fd37a tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:18.506960 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-3a0eaed3-6492-42f1-9e78-c8ee1f5fd37a tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:18.617607 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-3a0eaed3-6492-42f1-9e78-c8ee1f5fd37a tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2697aa77265e4f5783f87ffb3d4992b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1423c05c42b14519b401e22e16062781', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:06:18.629399 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-3a0eaed3-6492-42f1-9e78-c8ee1f5fd37a tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] 10.222.0.17 "GET /compute/v2.1/servers/bf5049e3-3446-468a-a334-d87825e50af4" status: 200 len: 1192 microversion: 2.1 time: 0.138321 Jun 16 23:06:18.640496 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 383/772] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:06:18 2022] GET /compute/v2.1/servers/bf5049e3-3446-468a-a334-d87825e50af4 => generated 1192 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:06:19.129692 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-17581d8e-de77-451c-93e3-c5ff30160ec2 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:06:19.130394 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-17581d8e-de77-451c-93e3-c5ff30160ec2 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] [instance: 07404710-1539-46ee-b4ff-2ef30af07f8e] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:06:19.137267 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-17581d8e-de77-451c-93e3-c5ff30160ec2 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:19.138062 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-17581d8e-de77-451c-93e3-c5ff30160ec2 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:19.138860 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-17581d8e-de77-451c-93e3-c5ff30160ec2 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:19.139527 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-17581d8e-de77-451c-93e3-c5ff30160ec2 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:19.180868 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-cdf59833-d2c9-4f44-b6fe-95e49eb1deaa tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:06:19.182723 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-cdf59833-d2c9-4f44-b6fe-95e49eb1deaa tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:06:19.189829 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-cdf59833-d2c9-4f44-b6fe-95e49eb1deaa tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:19.190516 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-cdf59833-d2c9-4f44-b6fe-95e49eb1deaa tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:19.191501 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-cdf59833-d2c9-4f44-b6fe-95e49eb1deaa tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:19.192108 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-cdf59833-d2c9-4f44-b6fe-95e49eb1deaa tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:19.593065 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-17581d8e-de77-451c-93e3-c5ff30160ec2 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3a2d16133b4af8a208682de8a7d111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0526c12e8bc947209e24daf5ddfad7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:06:19.601539 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-17581d8e-de77-451c-93e3-c5ff30160ec2 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] 10.222.0.17 "GET /compute/v2.1/servers/07404710-1539-46ee-b4ff-2ef30af07f8e" status: 200 len: 1367 microversion: 2.1 time: 0.475553 Jun 16 23:06:19.603558 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 390/773] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:06:19 2022] GET /compute/v2.1/servers/07404710-1539-46ee-b4ff-2ef30af07f8e => generated 1367 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:06:19.660323 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-cdf59833-d2c9-4f44-b6fe-95e49eb1deaa tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:06:19.699996 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-61f3f688-43eb-4700-9766-f5f18258e4c5 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:06:19.704886 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-61f3f688-43eb-4700-9766-f5f18258e4c5 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] [instance: bf5049e3-3446-468a-a334-d87825e50af4] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:06:19.712922 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-cdf59833-d2c9-4f44-b6fe-95e49eb1deaa tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:06:19.720950 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-cdf59833-d2c9-4f44-b6fe-95e49eb1deaa tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:06:19.725745 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-cdf59833-d2c9-4f44-b6fe-95e49eb1deaa tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "GET /compute/v2.1/servers/88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda" status: 200 len: 1724 microversion: 2.20 time: 0.548798 Jun 16 23:06:19.729021 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 384/774] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 23:06:19 2022] GET /compute/v2.1/servers/88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda => generated 1724 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 23:06:19.730668 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-61f3f688-43eb-4700-9766-f5f18258e4c5 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:19.731315 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-61f3f688-43eb-4700-9766-f5f18258e4c5 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:19.732596 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-61f3f688-43eb-4700-9766-f5f18258e4c5 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:19.736373 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-61f3f688-43eb-4700-9766-f5f18258e4c5 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:19.908045 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [req-80070a6e-5e37-4042-abe1-87ecd9d60e9c req-f498895c-bc83-4e78-9837-3bafd8ba624e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07404710-1539-46ee-b4ff-2ef30af07f8e", "tag": "e518f3e5-de33-40af-8a0b-72951461a47a"}]} {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 23:06:19.917766 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-80070a6e-5e37-4042-abe1-87ecd9d60e9c req-f498895c-bc83-4e78-9837-3bafd8ba624e service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:19.919779 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-80070a6e-5e37-4042-abe1-87ecd9d60e9c req-f498895c-bc83-4e78-9837-3bafd8ba624e service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:19.941072 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.compute.server_external_events [req-80070a6e-5e37-4042-abe1-87ecd9d60e9c req-f498895c-bc83-4e78-9837-3bafd8ba624e service nova] Creating event network-changed:e518f3e5-de33-40af-8a0b-72951461a47a for instance 07404710-1539-46ee-b4ff-2ef30af07f8e on hv-cinder-84623 Jun 16 23:06:19.947873 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [req-80070a6e-5e37-4042-abe1-87ecd9d60e9c req-f498895c-bc83-4e78-9837-3bafd8ba624e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046771 Jun 16 23:06:19.949109 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 385/775] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 23:06:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 23:06:20.156668 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-61f3f688-43eb-4700-9766-f5f18258e4c5 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2697aa77265e4f5783f87ffb3d4992b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1423c05c42b14519b401e22e16062781', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:06:20.167732 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-61f3f688-43eb-4700-9766-f5f18258e4c5 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] 10.222.0.17 "GET /compute/v2.1/servers/bf5049e3-3446-468a-a334-d87825e50af4" status: 200 len: 1265 microversion: 2.1 time: 0.523082 Jun 16 23:06:20.168661 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 391/776] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:06:19 2022] GET /compute/v2.1/servers/bf5049e3-3446-468a-a334-d87825e50af4 => generated 1265 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:06:20.620562 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-28a16dfd-f1e6-4f5d-ace4-7dd149f7dea2 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:06:20.621679 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-28a16dfd-f1e6-4f5d-ace4-7dd149f7dea2 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] [instance: 07404710-1539-46ee-b4ff-2ef30af07f8e] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:06:20.629906 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-28a16dfd-f1e6-4f5d-ace4-7dd149f7dea2 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:20.637579 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-28a16dfd-f1e6-4f5d-ace4-7dd149f7dea2 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:20.642793 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-28a16dfd-f1e6-4f5d-ace4-7dd149f7dea2 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:20.648353 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [req-b023fe49-4659-4eb9-a1e2-cf1d7ce14109 req-2affd923-e6ab-4f2f-a56c-0bf94779d4f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf5049e3-3446-468a-a334-d87825e50af4", "tag": "bee8d2e1-8544-499c-8311-99767df2181b"}]} {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 23:06:20.651606 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-28a16dfd-f1e6-4f5d-ace4-7dd149f7dea2 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:20.662016 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-b023fe49-4659-4eb9-a1e2-cf1d7ce14109 req-2affd923-e6ab-4f2f-a56c-0bf94779d4f8 service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:20.662570 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-b023fe49-4659-4eb9-a1e2-cf1d7ce14109 req-2affd923-e6ab-4f2f-a56c-0bf94779d4f8 service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:20.678224 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.compute.server_external_events [req-b023fe49-4659-4eb9-a1e2-cf1d7ce14109 req-2affd923-e6ab-4f2f-a56c-0bf94779d4f8 service nova] Creating event network-changed:bee8d2e1-8544-499c-8311-99767df2181b for instance bf5049e3-3446-468a-a334-d87825e50af4 on hv-cinder-84623 Jun 16 23:06:20.684822 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [req-b023fe49-4659-4eb9-a1e2-cf1d7ce14109 req-2affd923-e6ab-4f2f-a56c-0bf94779d4f8 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.205545 Jun 16 23:06:20.686340 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 386/777] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 23:06:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 23:06:20.746757 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-4a250f8a-43f9-47b7-b5b1-e5f1108993b0 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:06:20.747784 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-4a250f8a-43f9-47b7-b5b1-e5f1108993b0 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:06:20.755538 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-4a250f8a-43f9-47b7-b5b1-e5f1108993b0 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:20.756201 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-4a250f8a-43f9-47b7-b5b1-e5f1108993b0 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:20.757203 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-4a250f8a-43f9-47b7-b5b1-e5f1108993b0 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:20.757810 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-4a250f8a-43f9-47b7-b5b1-e5f1108993b0 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:21.076652 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-28a16dfd-f1e6-4f5d-ace4-7dd149f7dea2 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3a2d16133b4af8a208682de8a7d111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0526c12e8bc947209e24daf5ddfad7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:06:21.079623 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-4a250f8a-43f9-47b7-b5b1-e5f1108993b0 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:06:21.087017 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-28a16dfd-f1e6-4f5d-ace4-7dd149f7dea2 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] 10.222.0.17 "GET /compute/v2.1/servers/07404710-1539-46ee-b4ff-2ef30af07f8e" status: 200 len: 1367 microversion: 2.1 time: 0.470870 Jun 16 23:06:21.087734 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 392/778] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:06:20 2022] GET /compute/v2.1/servers/07404710-1539-46ee-b4ff-2ef30af07f8e => generated 1367 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 23:06:21.089203 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-4a250f8a-43f9-47b7-b5b1-e5f1108993b0 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:06:21.090773 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-4a250f8a-43f9-47b7-b5b1-e5f1108993b0 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:06:21.091958 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-4a250f8a-43f9-47b7-b5b1-e5f1108993b0 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "GET /compute/v2.1/servers/88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda" status: 200 len: 1724 microversion: 2.20 time: 0.349813 Jun 16 23:06:21.092669 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 387/779] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 23:06:20 2022] GET /compute/v2.1/servers/88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda => generated 1724 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 23:06:21.185853 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-7cced9d3-a3d5-4d8e-8ed2-aad23cf578a3 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:06:21.186395 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-7cced9d3-a3d5-4d8e-8ed2-aad23cf578a3 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] [instance: bf5049e3-3446-468a-a334-d87825e50af4] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:06:21.194511 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-7cced9d3-a3d5-4d8e-8ed2-aad23cf578a3 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:21.195197 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-7cced9d3-a3d5-4d8e-8ed2-aad23cf578a3 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:21.196165 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-7cced9d3-a3d5-4d8e-8ed2-aad23cf578a3 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:21.196609 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-7cced9d3-a3d5-4d8e-8ed2-aad23cf578a3 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:21.327875 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-7cced9d3-a3d5-4d8e-8ed2-aad23cf578a3 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2697aa77265e4f5783f87ffb3d4992b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1423c05c42b14519b401e22e16062781', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:06:21.336340 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-7cced9d3-a3d5-4d8e-8ed2-aad23cf578a3 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] 10.222.0.17 "GET /compute/v2.1/servers/bf5049e3-3446-468a-a334-d87825e50af4" status: 200 len: 1265 microversion: 2.1 time: 0.154574 Jun 16 23:06:21.337209 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 393/780] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:06:21 2022] GET /compute/v2.1/servers/bf5049e3-3446-468a-a334-d87825e50af4 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 23:06:22.105767 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-41292268-8b54-4b9d-9387-136f94378bab tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:06:22.107090 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-41292268-8b54-4b9d-9387-136f94378bab tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] [instance: 07404710-1539-46ee-b4ff-2ef30af07f8e] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:06:22.111204 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-1f3e2e2a-6e47-4692-b495-1a6cb9b19348 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:06:22.112079 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-1f3e2e2a-6e47-4692-b495-1a6cb9b19348 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:06:22.115629 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-41292268-8b54-4b9d-9387-136f94378bab tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:22.116194 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-41292268-8b54-4b9d-9387-136f94378bab tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:22.117332 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-41292268-8b54-4b9d-9387-136f94378bab tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:22.118345 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-1f3e2e2a-6e47-4692-b495-1a6cb9b19348 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:22.119420 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-1f3e2e2a-6e47-4692-b495-1a6cb9b19348 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:22.120390 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-1f3e2e2a-6e47-4692-b495-1a6cb9b19348 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:22.121003 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-1f3e2e2a-6e47-4692-b495-1a6cb9b19348 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:22.129281 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-41292268-8b54-4b9d-9387-136f94378bab tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:22.434989 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-41292268-8b54-4b9d-9387-136f94378bab tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3a2d16133b4af8a208682de8a7d111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0526c12e8bc947209e24daf5ddfad7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:06:22.443812 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-41292268-8b54-4b9d-9387-136f94378bab tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] 10.222.0.17 "GET /compute/v2.1/servers/07404710-1539-46ee-b4ff-2ef30af07f8e" status: 200 len: 1367 microversion: 2.1 time: 0.342379 Jun 16 23:06:22.457524 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-1f3e2e2a-6e47-4692-b495-1a6cb9b19348 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:06:22.461267 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 388/781] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:06:22 2022] GET /compute/v2.1/servers/07404710-1539-46ee-b4ff-2ef30af07f8e => generated 1367 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:06:22.469152 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-1f3e2e2a-6e47-4692-b495-1a6cb9b19348 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:06:22.469152 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-1f3e2e2a-6e47-4692-b495-1a6cb9b19348 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:06:22.469152 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-1f3e2e2a-6e47-4692-b495-1a6cb9b19348 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "GET /compute/v2.1/servers/88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda" status: 200 len: 1724 microversion: 2.20 time: 0.363323 Jun 16 23:06:22.474395 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 394/782] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 23:06:22 2022] GET /compute/v2.1/servers/88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda => generated 1724 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 23:06:22.479336 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-7a1c39c4-94c1-4f97-8938-35806d2187a7 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:06:22.480080 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-7a1c39c4-94c1-4f97-8938-35806d2187a7 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] [instance: bf5049e3-3446-468a-a334-d87825e50af4] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:06:22.486973 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-7a1c39c4-94c1-4f97-8938-35806d2187a7 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:22.487747 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-7a1c39c4-94c1-4f97-8938-35806d2187a7 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:22.488915 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-7a1c39c4-94c1-4f97-8938-35806d2187a7 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:22.489644 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-7a1c39c4-94c1-4f97-8938-35806d2187a7 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:22.817257 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-7a1c39c4-94c1-4f97-8938-35806d2187a7 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2697aa77265e4f5783f87ffb3d4992b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1423c05c42b14519b401e22e16062781', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:06:22.824906 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-7a1c39c4-94c1-4f97-8938-35806d2187a7 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] 10.222.0.17 "GET /compute/v2.1/servers/bf5049e3-3446-468a-a334-d87825e50af4" status: 200 len: 1265 microversion: 2.1 time: 0.349369 Jun 16 23:06:22.825455 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 389/783] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:06:22 2022] GET /compute/v2.1/servers/bf5049e3-3446-468a-a334-d87825e50af4 => generated 1265 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:06:23.461113 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-fa08d6e3-092a-4612-8415-8ee4e37c92ea tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:06:23.461748 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-fa08d6e3-092a-4612-8415-8ee4e37c92ea tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] [instance: 07404710-1539-46ee-b4ff-2ef30af07f8e] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:06:23.468131 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-fa08d6e3-092a-4612-8415-8ee4e37c92ea tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:23.468571 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-fa08d6e3-092a-4612-8415-8ee4e37c92ea tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:23.469954 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-fa08d6e3-092a-4612-8415-8ee4e37c92ea tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:23.470383 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-fa08d6e3-092a-4612-8415-8ee4e37c92ea tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:23.486494 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-5935977e-14d9-422b-a165-4ce51b79dc29 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:06:23.487536 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-5935977e-14d9-422b-a165-4ce51b79dc29 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:06:23.494333 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-5935977e-14d9-422b-a165-4ce51b79dc29 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:23.494943 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-5935977e-14d9-422b-a165-4ce51b79dc29 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:23.495825 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-5935977e-14d9-422b-a165-4ce51b79dc29 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:23.496370 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-5935977e-14d9-422b-a165-4ce51b79dc29 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:23.515586 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG dbcounter [-] [117563] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 23:06:23.655465 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-fa08d6e3-092a-4612-8415-8ee4e37c92ea tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3a2d16133b4af8a208682de8a7d111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0526c12e8bc947209e24daf5ddfad7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:06:23.663277 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-fa08d6e3-092a-4612-8415-8ee4e37c92ea tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] 10.222.0.17 "GET /compute/v2.1/servers/07404710-1539-46ee-b4ff-2ef30af07f8e" status: 200 len: 1367 microversion: 2.1 time: 0.206019 Jun 16 23:06:23.663865 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 395/784] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:06:23 2022] GET /compute/v2.1/servers/07404710-1539-46ee-b4ff-2ef30af07f8e => generated 1367 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:06:23.676663 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-5935977e-14d9-422b-a165-4ce51b79dc29 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:06:23.684935 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-5935977e-14d9-422b-a165-4ce51b79dc29 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:06:23.686464 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-5935977e-14d9-422b-a165-4ce51b79dc29 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:06:23.687658 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-5935977e-14d9-422b-a165-4ce51b79dc29 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "GET /compute/v2.1/servers/88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda" status: 200 len: 1724 microversion: 2.20 time: 0.205085 Jun 16 23:06:23.688254 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 390/785] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 23:06:23 2022] GET /compute/v2.1/servers/88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda => generated 1724 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 23:06:23.842703 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-60ca5156-28b0-418a-bdc1-3e882fb81715 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:06:23.843317 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-60ca5156-28b0-418a-bdc1-3e882fb81715 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] [instance: bf5049e3-3446-468a-a334-d87825e50af4] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:06:23.851113 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-60ca5156-28b0-418a-bdc1-3e882fb81715 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:23.851758 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-60ca5156-28b0-418a-bdc1-3e882fb81715 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:23.852898 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-60ca5156-28b0-418a-bdc1-3e882fb81715 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:23.853372 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-60ca5156-28b0-418a-bdc1-3e882fb81715 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:24.001982 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-60ca5156-28b0-418a-bdc1-3e882fb81715 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2697aa77265e4f5783f87ffb3d4992b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1423c05c42b14519b401e22e16062781', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:06:24.009341 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-60ca5156-28b0-418a-bdc1-3e882fb81715 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] 10.222.0.17 "GET /compute/v2.1/servers/bf5049e3-3446-468a-a334-d87825e50af4" status: 200 len: 1265 microversion: 2.1 time: 0.170534 Jun 16 23:06:24.009901 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 396/786] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:06:23 2022] GET /compute/v2.1/servers/bf5049e3-3446-468a-a334-d87825e50af4 => generated 1265 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:06:24.680092 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-37984e9b-e35f-41b0-8c25-d597f8b9d93d tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:06:24.680700 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-37984e9b-e35f-41b0-8c25-d597f8b9d93d tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] [instance: 07404710-1539-46ee-b4ff-2ef30af07f8e] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:06:24.687359 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-37984e9b-e35f-41b0-8c25-d597f8b9d93d tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:24.687815 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-37984e9b-e35f-41b0-8c25-d597f8b9d93d tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:24.688586 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-37984e9b-e35f-41b0-8c25-d597f8b9d93d tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:24.689023 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-37984e9b-e35f-41b0-8c25-d597f8b9d93d tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:24.706680 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-39a90039-f211-413c-bef8-f7ea4a0a82e4 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:06:24.707287 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-39a90039-f211-413c-bef8-f7ea4a0a82e4 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:06:24.713608 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-39a90039-f211-413c-bef8-f7ea4a0a82e4 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:24.714055 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-39a90039-f211-413c-bef8-f7ea4a0a82e4 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:24.714848 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-39a90039-f211-413c-bef8-f7ea4a0a82e4 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:24.715284 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-39a90039-f211-413c-bef8-f7ea4a0a82e4 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:24.880720 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-37984e9b-e35f-41b0-8c25-d597f8b9d93d tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3a2d16133b4af8a208682de8a7d111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0526c12e8bc947209e24daf5ddfad7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:06:24.892976 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-37984e9b-e35f-41b0-8c25-d597f8b9d93d tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] 10.222.0.17 "GET /compute/v2.1/servers/07404710-1539-46ee-b4ff-2ef30af07f8e" status: 200 len: 1367 microversion: 2.1 time: 0.214093 Jun 16 23:06:24.892976 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 391/787] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:06:24 2022] GET /compute/v2.1/servers/07404710-1539-46ee-b4ff-2ef30af07f8e => generated 1367 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:06:24.893223 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-39a90039-f211-413c-bef8-f7ea4a0a82e4 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:06:24.895533 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG dbcounter [-] [117562] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 23:06:24.905409 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-39a90039-f211-413c-bef8-f7ea4a0a82e4 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:06:24.907559 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-39a90039-f211-413c-bef8-f7ea4a0a82e4 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:06:24.908710 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-39a90039-f211-413c-bef8-f7ea4a0a82e4 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "GET /compute/v2.1/servers/88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda" status: 200 len: 1745 microversion: 2.20 time: 0.206182 Jun 16 23:06:24.909299 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 397/788] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 23:06:24 2022] GET /compute/v2.1/servers/88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda => generated 1745 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 23:06:25.025211 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-0159b0b9-65a4-471e-a13d-e28c3fd671b5 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:06:25.025740 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-0159b0b9-65a4-471e-a13d-e28c3fd671b5 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] [instance: bf5049e3-3446-468a-a334-d87825e50af4] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:06:25.032327 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-0159b0b9-65a4-471e-a13d-e28c3fd671b5 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:25.032771 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-0159b0b9-65a4-471e-a13d-e28c3fd671b5 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:25.033528 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-0159b0b9-65a4-471e-a13d-e28c3fd671b5 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:25.033963 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-0159b0b9-65a4-471e-a13d-e28c3fd671b5 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:25.160675 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-0159b0b9-65a4-471e-a13d-e28c3fd671b5 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2697aa77265e4f5783f87ffb3d4992b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1423c05c42b14519b401e22e16062781', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:06:25.167947 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-0159b0b9-65a4-471e-a13d-e28c3fd671b5 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] 10.222.0.17 "GET /compute/v2.1/servers/bf5049e3-3446-468a-a334-d87825e50af4" status: 200 len: 1265 microversion: 2.1 time: 0.146626 Jun 16 23:06:25.168492 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 392/789] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:06:25 2022] GET /compute/v2.1/servers/bf5049e3-3446-468a-a334-d87825e50af4 => generated 1265 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:06:25.764133 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [req-07ece0dc-b00d-4128-826d-037e31e05486 req-4b30df31-47ca-4f13-a08b-fe101f7d8420 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07404710-1539-46ee-b4ff-2ef30af07f8e", "name": "network-vif-plugged", "status": "completed", "tag": "e518f3e5-de33-40af-8a0b-72951461a47a"}]} {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 23:06:25.774024 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [req-07ece0dc-b00d-4128-826d-037e31e05486 req-4b30df31-47ca-4f13-a08b-fe101f7d8420 service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:25.774848 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [req-07ece0dc-b00d-4128-826d-037e31e05486 req-4b30df31-47ca-4f13-a08b-fe101f7d8420 service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:25.788167 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.compute.server_external_events [req-07ece0dc-b00d-4128-826d-037e31e05486 req-4b30df31-47ca-4f13-a08b-fe101f7d8420 service nova] Creating event network-vif-plugged:e518f3e5-de33-40af-8a0b-72951461a47a for instance 07404710-1539-46ee-b4ff-2ef30af07f8e on hv-cinder-84623 Jun 16 23:06:25.793304 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [req-07ece0dc-b00d-4128-826d-037e31e05486 req-4b30df31-47ca-4f13-a08b-fe101f7d8420 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099577 Jun 16 23:06:25.794221 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 398/790] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 23:06:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 23:06:25.910369 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-81e7c772-f671-4de0-8667-ef451beaf1d9 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:06:25.911667 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-81e7c772-f671-4de0-8667-ef451beaf1d9 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] [instance: 07404710-1539-46ee-b4ff-2ef30af07f8e] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:06:25.917874 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-81e7c772-f671-4de0-8667-ef451beaf1d9 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:25.918324 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-81e7c772-f671-4de0-8667-ef451beaf1d9 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:25.919120 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-81e7c772-f671-4de0-8667-ef451beaf1d9 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:25.919567 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-81e7c772-f671-4de0-8667-ef451beaf1d9 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:25.927635 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-67af4c4e-2275-4a93-82ef-0f9c8d8d7167 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:06:25.928422 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-67af4c4e-2275-4a93-82ef-0f9c8d8d7167 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:06:25.934796 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-67af4c4e-2275-4a93-82ef-0f9c8d8d7167 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:25.935333 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-67af4c4e-2275-4a93-82ef-0f9c8d8d7167 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:25.936185 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-67af4c4e-2275-4a93-82ef-0f9c8d8d7167 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:25.936704 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-67af4c4e-2275-4a93-82ef-0f9c8d8d7167 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:26.166328 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-81e7c772-f671-4de0-8667-ef451beaf1d9 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3a2d16133b4af8a208682de8a7d111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0526c12e8bc947209e24daf5ddfad7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:06:26.170357 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-67af4c4e-2275-4a93-82ef-0f9c8d8d7167 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:06:26.174349 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-81e7c772-f671-4de0-8667-ef451beaf1d9 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] 10.222.0.17 "GET /compute/v2.1/servers/07404710-1539-46ee-b4ff-2ef30af07f8e" status: 200 len: 1367 microversion: 2.1 time: 0.267844 Jun 16 23:06:26.174944 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 393/791] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:06:25 2022] GET /compute/v2.1/servers/07404710-1539-46ee-b4ff-2ef30af07f8e => generated 1367 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:06:26.179254 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-67af4c4e-2275-4a93-82ef-0f9c8d8d7167 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:06:26.181011 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-67af4c4e-2275-4a93-82ef-0f9c8d8d7167 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:06:26.182115 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-67af4c4e-2275-4a93-82ef-0f9c8d8d7167 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "GET /compute/v2.1/servers/88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda" status: 200 len: 1745 microversion: 2.20 time: 0.258737 Jun 16 23:06:26.182823 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 399/792] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 23:06:25 2022] GET /compute/v2.1/servers/88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda => generated 1745 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 23:06:26.184386 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-2aac2b55-7463-45be-87e5-a02097b8e85d tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:06:26.184988 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-2aac2b55-7463-45be-87e5-a02097b8e85d tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] [instance: bf5049e3-3446-468a-a334-d87825e50af4] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:06:26.191067 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-2aac2b55-7463-45be-87e5-a02097b8e85d tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:26.191515 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-2aac2b55-7463-45be-87e5-a02097b8e85d tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:26.192272 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-2aac2b55-7463-45be-87e5-a02097b8e85d tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:26.192704 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-2aac2b55-7463-45be-87e5-a02097b8e85d tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:26.322352 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-2aac2b55-7463-45be-87e5-a02097b8e85d tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2697aa77265e4f5783f87ffb3d4992b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1423c05c42b14519b401e22e16062781', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:06:26.329682 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-2aac2b55-7463-45be-87e5-a02097b8e85d tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] 10.222.0.17 "GET /compute/v2.1/servers/bf5049e3-3446-468a-a334-d87825e50af4" status: 200 len: 1265 microversion: 2.1 time: 0.148896 Jun 16 23:06:26.330493 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 394/793] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:06:26 2022] GET /compute/v2.1/servers/bf5049e3-3446-468a-a334-d87825e50af4 => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 23:06:27.191092 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-146f3d61-3486-4786-9aec-968fa164e2cc tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:06:27.191700 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-146f3d61-3486-4786-9aec-968fa164e2cc tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] [instance: 07404710-1539-46ee-b4ff-2ef30af07f8e] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:06:27.194226 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG dbcounter [-] [117562] Writing DB stats nova_cell0:SELECT=2 {{(pid=117562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 23:06:27.195090 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG dbcounter [-] [117562] Writing DB stats nova_cell0:SELECT=6 {{(pid=117562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 23:06:27.201107 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-146f3d61-3486-4786-9aec-968fa164e2cc tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:27.201412 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-19777d55-ab67-48bb-b437-2b0dcb087127 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:06:27.201856 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-146f3d61-3486-4786-9aec-968fa164e2cc tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:27.202073 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-19777d55-ab67-48bb-b437-2b0dcb087127 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:06:27.202340 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-146f3d61-3486-4786-9aec-968fa164e2cc tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:27.203691 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-146f3d61-3486-4786-9aec-968fa164e2cc tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:27.204683 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG dbcounter [-] [117563] Writing DB stats nova_cell0:SELECT=2 {{(pid=117563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 23:06:27.213979 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-19777d55-ab67-48bb-b437-2b0dcb087127 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:27.214508 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-19777d55-ab67-48bb-b437-2b0dcb087127 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:27.215383 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-19777d55-ab67-48bb-b437-2b0dcb087127 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:27.215882 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-19777d55-ab67-48bb-b437-2b0dcb087127 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:27.429002 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-146f3d61-3486-4786-9aec-968fa164e2cc tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3a2d16133b4af8a208682de8a7d111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0526c12e8bc947209e24daf5ddfad7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:06:27.437139 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-19777d55-ab67-48bb-b437-2b0dcb087127 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:06:27.440046 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-146f3d61-3486-4786-9aec-968fa164e2cc tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] 10.222.0.17 "GET /compute/v2.1/servers/07404710-1539-46ee-b4ff-2ef30af07f8e" status: 200 len: 1367 microversion: 2.1 time: 0.252783 Jun 16 23:06:27.440619 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 400/794] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:06:27 2022] GET /compute/v2.1/servers/07404710-1539-46ee-b4ff-2ef30af07f8e => generated 1367 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:06:27.449608 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-19777d55-ab67-48bb-b437-2b0dcb087127 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:06:27.450833 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-9d0ed599-517b-40b1-9439-4aed3673ca68 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:06:27.451446 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-9d0ed599-517b-40b1-9439-4aed3673ca68 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] [instance: bf5049e3-3446-468a-a334-d87825e50af4] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:06:27.451943 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-19777d55-ab67-48bb-b437-2b0dcb087127 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:06:27.454199 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-19777d55-ab67-48bb-b437-2b0dcb087127 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "GET /compute/v2.1/servers/88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda" status: 200 len: 1745 microversion: 2.20 time: 0.256557 Jun 16 23:06:27.455579 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 395/795] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 23:06:27 2022] GET /compute/v2.1/servers/88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda => generated 1745 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 23:06:27.464823 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-9d0ed599-517b-40b1-9439-4aed3673ca68 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:27.465276 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-9d0ed599-517b-40b1-9439-4aed3673ca68 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:27.466056 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-9d0ed599-517b-40b1-9439-4aed3673ca68 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:27.468462 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-9d0ed599-517b-40b1-9439-4aed3673ca68 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:27.620504 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-9d0ed599-517b-40b1-9439-4aed3673ca68 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2697aa77265e4f5783f87ffb3d4992b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1423c05c42b14519b401e22e16062781', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:06:27.629513 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-9d0ed599-517b-40b1-9439-4aed3673ca68 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] 10.222.0.17 "GET /compute/v2.1/servers/bf5049e3-3446-468a-a334-d87825e50af4" status: 200 len: 1265 microversion: 2.1 time: 0.183716 Jun 16 23:06:27.639719 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 401/796] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:06:27 2022] GET /compute/v2.1/servers/bf5049e3-3446-468a-a334-d87825e50af4 => generated 1265 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:06:28.457485 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-254f1ce7-c338-4d76-8806-f8cf3650b165 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:06:28.458176 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-254f1ce7-c338-4d76-8806-f8cf3650b165 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] [instance: 07404710-1539-46ee-b4ff-2ef30af07f8e] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:06:28.459983 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG dbcounter [-] [117563] Writing DB stats nova_cell0:SELECT=14 {{(pid=117563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 23:06:28.465920 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-254f1ce7-c338-4d76-8806-f8cf3650b165 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:28.466372 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-254f1ce7-c338-4d76-8806-f8cf3650b165 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:28.467186 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-254f1ce7-c338-4d76-8806-f8cf3650b165 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:28.467631 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-254f1ce7-c338-4d76-8806-f8cf3650b165 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:28.474535 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-2eaf1870-959d-4ea0-b15d-1d50c563a789 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:06:28.475296 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-2eaf1870-959d-4ea0-b15d-1d50c563a789 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:06:28.483181 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-2eaf1870-959d-4ea0-b15d-1d50c563a789 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:28.483345 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-2eaf1870-959d-4ea0-b15d-1d50c563a789 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:28.484727 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-2eaf1870-959d-4ea0-b15d-1d50c563a789 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:28.485232 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-2eaf1870-959d-4ea0-b15d-1d50c563a789 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:28.709296 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-254f1ce7-c338-4d76-8806-f8cf3650b165 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3a2d16133b4af8a208682de8a7d111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0526c12e8bc947209e24daf5ddfad7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:06:28.718200 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-254f1ce7-c338-4d76-8806-f8cf3650b165 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] 10.222.0.17 "GET /compute/v2.1/servers/07404710-1539-46ee-b4ff-2ef30af07f8e" status: 200 len: 1556 microversion: 2.1 time: 0.264797 Jun 16 23:06:28.722724 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 396/797] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:06:28 2022] GET /compute/v2.1/servers/07404710-1539-46ee-b4ff-2ef30af07f8e => generated 1556 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:06:28.726581 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-2eaf1870-959d-4ea0-b15d-1d50c563a789 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:06:28.735888 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-3608593c-06cb-43af-bbde-d4e4abd698dc tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:06:28.736145 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-2eaf1870-959d-4ea0-b15d-1d50c563a789 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:06:28.736579 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-3608593c-06cb-43af-bbde-d4e4abd698dc tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] [instance: bf5049e3-3446-468a-a334-d87825e50af4] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:06:28.738177 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-2eaf1870-959d-4ea0-b15d-1d50c563a789 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:06:28.739381 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-2eaf1870-959d-4ea0-b15d-1d50c563a789 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "GET /compute/v2.1/servers/88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda" status: 200 len: 1745 microversion: 2.20 time: 0.269240 Jun 16 23:06:28.740125 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 402/798] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 23:06:28 2022] GET /compute/v2.1/servers/88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda => generated 1745 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 23:06:28.744598 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-3608593c-06cb-43af-bbde-d4e4abd698dc tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:28.744809 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-e8315282-fbe2-4424-bc33-f5c0c15fc10f tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:06:28.745062 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-3608593c-06cb-43af-bbde-d4e4abd698dc tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:28.745487 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-e8315282-fbe2-4424-bc33-f5c0c15fc10f tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] [instance: 07404710-1539-46ee-b4ff-2ef30af07f8e] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:06:28.745847 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-3608593c-06cb-43af-bbde-d4e4abd698dc tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:28.746292 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-3608593c-06cb-43af-bbde-d4e4abd698dc tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:28.751428 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-e8315282-fbe2-4424-bc33-f5c0c15fc10f tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:28.751884 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-e8315282-fbe2-4424-bc33-f5c0c15fc10f tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:28.752707 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-e8315282-fbe2-4424-bc33-f5c0c15fc10f tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:28.753162 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-e8315282-fbe2-4424-bc33-f5c0c15fc10f tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:28.884425 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-e8315282-fbe2-4424-bc33-f5c0c15fc10f tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] 10.222.0.17 "GET /compute/v2.1/servers/07404710-1539-46ee-b4ff-2ef30af07f8e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.143080 Jun 16 23:06:28.885196 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 403/799] 10.222.0.17 () {58 vars in 1274 bytes} [Thu Jun 16 23:06:28 2022] GET /compute/v2.1/servers/07404710-1539-46ee-b4ff-2ef30af07f8e/os-interface => generated 284 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 23:06:28.960948 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-3608593c-06cb-43af-bbde-d4e4abd698dc tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2697aa77265e4f5783f87ffb3d4992b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1423c05c42b14519b401e22e16062781', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:06:28.969356 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-3608593c-06cb-43af-bbde-d4e4abd698dc tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] 10.222.0.17 "GET /compute/v2.1/servers/bf5049e3-3446-468a-a334-d87825e50af4" status: 200 len: 1265 microversion: 2.1 time: 0.244474 Jun 16 23:06:28.970703 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 397/800] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:06:28 2022] GET /compute/v2.1/servers/bf5049e3-3446-468a-a334-d87825e50af4 => generated 1265 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:06:29.762019 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-412e0565-9f59-4580-b536-af09064a3936 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:06:29.762776 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-412e0565-9f59-4580-b536-af09064a3936 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:06:29.773776 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-412e0565-9f59-4580-b536-af09064a3936 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:29.774240 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-412e0565-9f59-4580-b536-af09064a3936 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:29.780448 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-412e0565-9f59-4580-b536-af09064a3936 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:29.780987 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-412e0565-9f59-4580-b536-af09064a3936 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:29.913853 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [req-7bd272e2-f712-4ee0-9771-0e6ce812952b req-4a3cc223-9f2f-44df-9e92-989fcfefcb33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda", "name": "network-vif-plugged", "status": "completed", "tag": "4b3b90f0-95df-4c59-9186-169416370496"}]} {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 23:06:29.940023 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-7bd272e2-f712-4ee0-9771-0e6ce812952b req-4a3cc223-9f2f-44df-9e92-989fcfefcb33 service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:29.944235 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-7bd272e2-f712-4ee0-9771-0e6ce812952b req-4a3cc223-9f2f-44df-9e92-989fcfefcb33 service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:29.990447 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.compute.server_external_events [req-7bd272e2-f712-4ee0-9771-0e6ce812952b req-4a3cc223-9f2f-44df-9e92-989fcfefcb33 service nova] Creating event network-vif-plugged:4b3b90f0-95df-4c59-9186-169416370496 for instance 88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda on hv-cinder-84623 Jun 16 23:06:30.012879 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [req-7bd272e2-f712-4ee0-9771-0e6ce812952b req-4a3cc223-9f2f-44df-9e92-989fcfefcb33 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098841 Jun 16 23:06:30.014224 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 398/801] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 23:06:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 23:06:30.020646 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-fe3554a1-333a-445a-893c-98bf6048cc48 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:06:30.021595 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-fe3554a1-333a-445a-893c-98bf6048cc48 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] [instance: bf5049e3-3446-468a-a334-d87825e50af4] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:06:30.032898 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-fe3554a1-333a-445a-893c-98bf6048cc48 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:30.033617 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-fe3554a1-333a-445a-893c-98bf6048cc48 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:30.034743 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-fe3554a1-333a-445a-893c-98bf6048cc48 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:30.035462 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-fe3554a1-333a-445a-893c-98bf6048cc48 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:30.178753 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-412e0565-9f59-4580-b536-af09064a3936 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:06:30.188851 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-412e0565-9f59-4580-b536-af09064a3936 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:06:30.193776 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-412e0565-9f59-4580-b536-af09064a3936 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:06:30.196813 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-412e0565-9f59-4580-b536-af09064a3936 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "GET /compute/v2.1/servers/88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda" status: 200 len: 1740 microversion: 2.20 time: 0.440820 Jun 16 23:06:30.199981 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 404/802] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 23:06:29 2022] GET /compute/v2.1/servers/88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda => generated 1740 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 23:06:30.395564 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-fe3554a1-333a-445a-893c-98bf6048cc48 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2697aa77265e4f5783f87ffb3d4992b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1423c05c42b14519b401e22e16062781', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:06:30.410037 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-fe3554a1-333a-445a-893c-98bf6048cc48 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] 10.222.0.17 "GET /compute/v2.1/servers/bf5049e3-3446-468a-a334-d87825e50af4" status: 200 len: 1265 microversion: 2.1 time: 0.394273 Jun 16 23:06:30.428826 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 399/803] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:06:30 2022] GET /compute/v2.1/servers/bf5049e3-3446-468a-a334-d87825e50af4 => generated 1265 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:06:30.644740 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [req-4afa8e1b-ef69-4a97-89e8-737d4979ec22 req-aa4cd83e-5c5f-4874-a348-acd484ab7863 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07404710-1539-46ee-b4ff-2ef30af07f8e", "tag": "e518f3e5-de33-40af-8a0b-72951461a47a"}]} {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 23:06:30.660390 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [req-4afa8e1b-ef69-4a97-89e8-737d4979ec22 req-aa4cd83e-5c5f-4874-a348-acd484ab7863 service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:30.661106 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [req-4afa8e1b-ef69-4a97-89e8-737d4979ec22 req-aa4cd83e-5c5f-4874-a348-acd484ab7863 service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:30.680732 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.compute.server_external_events [req-4afa8e1b-ef69-4a97-89e8-737d4979ec22 req-aa4cd83e-5c5f-4874-a348-acd484ab7863 service nova] Creating event network-changed:e518f3e5-de33-40af-8a0b-72951461a47a for instance 07404710-1539-46ee-b4ff-2ef30af07f8e on hv-cinder-84623 Jun 16 23:06:30.687940 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [req-4afa8e1b-ef69-4a97-89e8-737d4979ec22 req-aa4cd83e-5c5f-4874-a348-acd484ab7863 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047320 Jun 16 23:06:30.693541 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 405/804] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 23:06:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 23:06:31.216927 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-1934f48f-c8db-43d9-88e7-fef0e175d0cc tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:06:31.217564 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-1934f48f-c8db-43d9-88e7-fef0e175d0cc tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:06:31.224342 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-1934f48f-c8db-43d9-88e7-fef0e175d0cc tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:31.224717 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-1934f48f-c8db-43d9-88e7-fef0e175d0cc tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:31.225503 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-1934f48f-c8db-43d9-88e7-fef0e175d0cc tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:31.225944 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-1934f48f-c8db-43d9-88e7-fef0e175d0cc tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:31.448391 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-906033b3-f321-466a-92d4-77534edd5fc3 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:06:31.453310 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-906033b3-f321-466a-92d4-77534edd5fc3 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] [instance: bf5049e3-3446-468a-a334-d87825e50af4] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:06:31.463536 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-906033b3-f321-466a-92d4-77534edd5fc3 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:31.464375 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-906033b3-f321-466a-92d4-77534edd5fc3 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:31.483515 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-906033b3-f321-466a-92d4-77534edd5fc3 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:31.486491 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-906033b3-f321-466a-92d4-77534edd5fc3 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:31.677176 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-1934f48f-c8db-43d9-88e7-fef0e175d0cc tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:06:31.690991 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-1934f48f-c8db-43d9-88e7-fef0e175d0cc tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:06:31.692859 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-1934f48f-c8db-43d9-88e7-fef0e175d0cc tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:06:31.694116 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-1934f48f-c8db-43d9-88e7-fef0e175d0cc tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "GET /compute/v2.1/servers/88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda" status: 200 len: 1740 microversion: 2.20 time: 0.481107 Jun 16 23:06:31.694800 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 400/805] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 23:06:31 2022] GET /compute/v2.1/servers/88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda => generated 1740 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 23:06:31.713071 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-906033b3-f321-466a-92d4-77534edd5fc3 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2697aa77265e4f5783f87ffb3d4992b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1423c05c42b14519b401e22e16062781', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:06:31.730986 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-906033b3-f321-466a-92d4-77534edd5fc3 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] 10.222.0.17 "GET /compute/v2.1/servers/bf5049e3-3446-468a-a334-d87825e50af4" status: 200 len: 1265 microversion: 2.1 time: 0.305135 Jun 16 23:06:31.732192 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 406/806] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:06:31 2022] GET /compute/v2.1/servers/bf5049e3-3446-468a-a334-d87825e50af4 => generated 1265 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:06:32.062713 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [req-96d78e0f-3ee2-4f81-a7a9-31c29c43797d req-82cbd10b-ec6c-4b5e-bdeb-a6663ace1f81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf5049e3-3446-468a-a334-d87825e50af4", "name": "network-vif-plugged", "status": "completed", "tag": "bee8d2e1-8544-499c-8311-99767df2181b"}]} {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 23:06:32.079272 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-96d78e0f-3ee2-4f81-a7a9-31c29c43797d req-82cbd10b-ec6c-4b5e-bdeb-a6663ace1f81 service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:32.080156 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-96d78e0f-3ee2-4f81-a7a9-31c29c43797d req-82cbd10b-ec6c-4b5e-bdeb-a6663ace1f81 service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:32.092632 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.compute.server_external_events [req-96d78e0f-3ee2-4f81-a7a9-31c29c43797d req-82cbd10b-ec6c-4b5e-bdeb-a6663ace1f81 service nova] Creating event network-vif-plugged:bee8d2e1-8544-499c-8311-99767df2181b for instance bf5049e3-3446-468a-a334-d87825e50af4 on hv-cinder-84623 Jun 16 23:06:32.098384 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [req-96d78e0f-3ee2-4f81-a7a9-31c29c43797d req-82cbd10b-ec6c-4b5e-bdeb-a6663ace1f81 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040027 Jun 16 23:06:32.099585 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 401/807] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 23:06:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 23:06:32.713180 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-30e84d9c-4fff-4ee3-ad52-bac72c6f4468 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:06:32.713782 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-30e84d9c-4fff-4ee3-ad52-bac72c6f4468 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:06:32.725122 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-30e84d9c-4fff-4ee3-ad52-bac72c6f4468 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:32.725868 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-30e84d9c-4fff-4ee3-ad52-bac72c6f4468 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:32.726866 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-30e84d9c-4fff-4ee3-ad52-bac72c6f4468 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:32.727455 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-30e84d9c-4fff-4ee3-ad52-bac72c6f4468 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:32.750016 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-db3a0daf-df49-4b74-ae52-09b91f324657 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:06:32.751513 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-db3a0daf-df49-4b74-ae52-09b91f324657 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] [instance: bf5049e3-3446-468a-a334-d87825e50af4] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:06:32.758762 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-db3a0daf-df49-4b74-ae52-09b91f324657 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:32.759451 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-db3a0daf-df49-4b74-ae52-09b91f324657 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:32.760401 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-db3a0daf-df49-4b74-ae52-09b91f324657 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:32.761004 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-db3a0daf-df49-4b74-ae52-09b91f324657 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:32.974226 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-db3a0daf-df49-4b74-ae52-09b91f324657 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2697aa77265e4f5783f87ffb3d4992b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1423c05c42b14519b401e22e16062781', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:06:32.976131 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-30e84d9c-4fff-4ee3-ad52-bac72c6f4468 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:06:32.995593 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-30e84d9c-4fff-4ee3-ad52-bac72c6f4468 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:06:32.998063 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-30e84d9c-4fff-4ee3-ad52-bac72c6f4468 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:06:33.005398 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-db3a0daf-df49-4b74-ae52-09b91f324657 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] 10.222.0.17 "GET /compute/v2.1/servers/bf5049e3-3446-468a-a334-d87825e50af4" status: 200 len: 1265 microversion: 2.1 time: 0.259153 Jun 16 23:06:33.006642 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 402/808] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:06:32 2022] GET /compute/v2.1/servers/bf5049e3-3446-468a-a334-d87825e50af4 => generated 1265 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:06:33.007536 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-30e84d9c-4fff-4ee3-ad52-bac72c6f4468 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "GET /compute/v2.1/servers/88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda" status: 200 len: 1740 microversion: 2.20 time: 0.298120 Jun 16 23:06:33.008517 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 407/809] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 23:06:32 2022] GET /compute/v2.1/servers/88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda => generated 1740 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 23:06:33.024895 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-2e89efc8-4688-4e31-b18e-a088b4fc0b11 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1292497408", "imageRef": "2b486731-e5ea-4159-b6b1-ed0083e00543", "flavorRef": "452", "networks": [{"uuid": "5e7c7db6-6141-4dba-9168-34f346c470b1"}]}} {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 23:06:33.091978 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.network.neutron [None req-2e89efc8-4688-4e31-b18e-a088b4fc0b11 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] validate_networks() for [('5e7c7db6-6141-4dba-9168-34f346c470b1', None, None, None, None, None)] {{(pid=117563) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 23:06:33.502864 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.virt.hardware [None req-2e89efc8-4688-4e31-b18e-a088b4fc0b11 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Flavor limits 0:0:0 {{(pid=117563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 23:06:33.503314 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.virt.hardware [None req-2e89efc8-4688-4e31-b18e-a088b4fc0b11 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Image limits 0:0:0 {{(pid=117563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 23:06:33.503809 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.virt.hardware [None req-2e89efc8-4688-4e31-b18e-a088b4fc0b11 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Flavor pref 0:0:0 {{(pid=117563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 23:06:33.504363 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.virt.hardware [None req-2e89efc8-4688-4e31-b18e-a088b4fc0b11 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Image pref 0:0:0 {{(pid=117563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 23:06:33.505079 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.virt.hardware [None req-2e89efc8-4688-4e31-b18e-a088b4fc0b11 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 23:06:33.519679 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-2e89efc8-4688-4e31-b18e-a088b4fc0b11 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:33.520133 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-2e89efc8-4688-4e31-b18e-a088b4fc0b11 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:33.520937 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-2e89efc8-4688-4e31-b18e-a088b4fc0b11 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:33.521384 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-2e89efc8-4688-4e31-b18e-a088b4fc0b11 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:33.543988 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.quota [None req-2e89efc8-4688-4e31-b18e-a088b4fc0b11 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Getting quotas for project 91ee581f47a5419098d02102081f617d. Resources: {'instances', 'cores', 'ram'} {{(pid=117563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 23:06:33.548954 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.quota [None req-2e89efc8-4688-4e31-b18e-a088b4fc0b11 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Getting quotas for user 61e40b7f3da047fcbea943e7f1206bcb and project 91ee581f47a5419098d02102081f617d. Resources: {'instances', 'cores', 'ram'} {{(pid=117563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 23:06:33.560222 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-2e89efc8-4688-4e31-b18e-a088b4fc0b11 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Going to run 1 instances... {{(pid=117563) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 23:06:33.563203 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-2e89efc8-4688-4e31-b18e-a088b4fc0b11 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] [instance: 97545521-e12e-4dba-b601-3ba8b4c01e17] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2b486731-e5ea-4159-b6b1-ed0083e00543',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117563) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 23:06:33.584513 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG dbcounter [-] [117563] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=1,nova_api:INSERT=6 {{(pid=117563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 23:06:33.612374 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-2e89efc8-4688-4e31-b18e-a088b4fc0b11 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.603778 Jun 16 23:06:33.613675 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 403/810] 10.222.0.17 () {60 vars in 1146 bytes} [Thu Jun 16 23:06:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 606 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 23:06:33.622862 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-c50c1031-ff13-465b-abee-01c7b026113b tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:06:33.623484 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-c50c1031-ff13-465b-abee-01c7b026113b tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] [instance: 97545521-e12e-4dba-b601-3ba8b4c01e17] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:06:33.685561 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-c50c1031-ff13-465b-abee-01c7b026113b tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e40b7f3da047fcbea943e7f1206bcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee581f47a5419098d02102081f617d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:06:33.693232 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-c50c1031-ff13-465b-abee-01c7b026113b tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] 10.222.0.17 "GET /compute/v2.1/servers/97545521-e12e-4dba-b601-3ba8b4c01e17" status: 200 len: 1214 microversion: 2.1 time: 0.074176 Jun 16 23:06:33.693959 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 408/811] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:06:33 2022] GET /compute/v2.1/servers/97545521-e12e-4dba-b601-3ba8b4c01e17 => generated 1214 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:06:34.025687 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-0a397da7-3dbf-4b34-a73f-63614587d2b0 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:06:34.026309 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-c8f868d1-7e36-4190-8c29-53c95f1ab916 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:06:34.026698 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-c8f868d1-7e36-4190-8c29-53c95f1ab916 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:06:34.027524 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-0a397da7-3dbf-4b34-a73f-63614587d2b0 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] [instance: bf5049e3-3446-468a-a334-d87825e50af4] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:06:34.034910 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-c8f868d1-7e36-4190-8c29-53c95f1ab916 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:34.035758 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-c8f868d1-7e36-4190-8c29-53c95f1ab916 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:34.036812 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-c8f868d1-7e36-4190-8c29-53c95f1ab916 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:34.037457 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-c8f868d1-7e36-4190-8c29-53c95f1ab916 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:34.039782 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-0a397da7-3dbf-4b34-a73f-63614587d2b0 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:34.040491 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-0a397da7-3dbf-4b34-a73f-63614587d2b0 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:34.041544 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-0a397da7-3dbf-4b34-a73f-63614587d2b0 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:34.042220 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-0a397da7-3dbf-4b34-a73f-63614587d2b0 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:34.550024 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-c8f868d1-7e36-4190-8c29-53c95f1ab916 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:06:34.556938 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-0a397da7-3dbf-4b34-a73f-63614587d2b0 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2697aa77265e4f5783f87ffb3d4992b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1423c05c42b14519b401e22e16062781', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:06:34.559038 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-c8f868d1-7e36-4190-8c29-53c95f1ab916 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:06:34.560615 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-c8f868d1-7e36-4190-8c29-53c95f1ab916 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:06:34.562356 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-c8f868d1-7e36-4190-8c29-53c95f1ab916 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "GET /compute/v2.1/servers/88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda" status: 200 len: 1740 microversion: 2.20 time: 0.540632 Jun 16 23:06:34.563582 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 404/812] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 23:06:34 2022] GET /compute/v2.1/servers/88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda => generated 1740 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 23:06:34.569762 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-0a397da7-3dbf-4b34-a73f-63614587d2b0 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] 10.222.0.17 "GET /compute/v2.1/servers/bf5049e3-3446-468a-a334-d87825e50af4" status: 200 len: 1265 microversion: 2.1 time: 0.547866 Jun 16 23:06:34.570338 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 409/813] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:06:34 2022] GET /compute/v2.1/servers/bf5049e3-3446-468a-a334-d87825e50af4 => generated 1265 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 23:06:34.711480 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-d3d4e6be-c848-484b-96a2-6f6d86c8e83c tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:06:34.712556 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-d3d4e6be-c848-484b-96a2-6f6d86c8e83c tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] [instance: 97545521-e12e-4dba-b601-3ba8b4c01e17] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:06:34.719178 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-d3d4e6be-c848-484b-96a2-6f6d86c8e83c tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:34.719923 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-d3d4e6be-c848-484b-96a2-6f6d86c8e83c tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:34.720878 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-d3d4e6be-c848-484b-96a2-6f6d86c8e83c tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:34.721926 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-d3d4e6be-c848-484b-96a2-6f6d86c8e83c tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:34.787485 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-d3d4e6be-c848-484b-96a2-6f6d86c8e83c tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e40b7f3da047fcbea943e7f1206bcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee581f47a5419098d02102081f617d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:06:34.797901 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-d3d4e6be-c848-484b-96a2-6f6d86c8e83c tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] 10.222.0.17 "GET /compute/v2.1/servers/97545521-e12e-4dba-b601-3ba8b4c01e17" status: 200 len: 1266 microversion: 2.1 time: 0.091071 Jun 16 23:06:34.802792 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 405/814] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:06:34 2022] GET /compute/v2.1/servers/97545521-e12e-4dba-b601-3ba8b4c01e17 => generated 1266 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:06:35.586635 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-92cffa83-8f41-4252-b274-1a6382d6220d tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:06:35.588174 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-4429872c-0d6f-41d3-8570-86aaca2ca56e tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:06:35.589253 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-92cffa83-8f41-4252-b274-1a6382d6220d tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] [instance: bf5049e3-3446-468a-a334-d87825e50af4] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:06:35.590086 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-4429872c-0d6f-41d3-8570-86aaca2ca56e tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:06:35.606133 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-92cffa83-8f41-4252-b274-1a6382d6220d tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:35.606623 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-92cffa83-8f41-4252-b274-1a6382d6220d tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:35.609535 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-4429872c-0d6f-41d3-8570-86aaca2ca56e tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:35.610207 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-4429872c-0d6f-41d3-8570-86aaca2ca56e tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:35.611201 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-4429872c-0d6f-41d3-8570-86aaca2ca56e tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:35.612252 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-92cffa83-8f41-4252-b274-1a6382d6220d tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:35.612876 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-4429872c-0d6f-41d3-8570-86aaca2ca56e tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:35.615566 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-92cffa83-8f41-4252-b274-1a6382d6220d tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:35.929617 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-92cffa83-8f41-4252-b274-1a6382d6220d tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2697aa77265e4f5783f87ffb3d4992b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1423c05c42b14519b401e22e16062781', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:06:35.942681 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-92cffa83-8f41-4252-b274-1a6382d6220d tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] 10.222.0.17 "GET /compute/v2.1/servers/bf5049e3-3446-468a-a334-d87825e50af4" status: 200 len: 1453 microversion: 2.1 time: 0.360235 Jun 16 23:06:35.948118 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-4429872c-0d6f-41d3-8570-86aaca2ca56e tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:06:35.958283 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 406/815] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:06:35 2022] GET /compute/v2.1/servers/bf5049e3-3446-468a-a334-d87825e50af4 => generated 1453 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:06:35.964637 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-aa7a012c-ebfd-4593-b3d8-7a4645596d2b tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:06:35.965523 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-aa7a012c-ebfd-4593-b3d8-7a4645596d2b tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] [instance: 97545521-e12e-4dba-b601-3ba8b4c01e17] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:06:35.971002 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-4429872c-0d6f-41d3-8570-86aaca2ca56e tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:06:35.973917 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-4429872c-0d6f-41d3-8570-86aaca2ca56e tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:06:35.977301 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-aa7a012c-ebfd-4593-b3d8-7a4645596d2b tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:35.977828 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-aa7a012c-ebfd-4593-b3d8-7a4645596d2b tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:35.978857 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-4429872c-0d6f-41d3-8570-86aaca2ca56e tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "GET /compute/v2.1/servers/88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda" status: 200 len: 1740 microversion: 2.20 time: 0.402086 Jun 16 23:06:35.979267 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-aa7a012c-ebfd-4593-b3d8-7a4645596d2b tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:35.979905 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-aa7a012c-ebfd-4593-b3d8-7a4645596d2b tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:35.990853 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 410/816] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 23:06:35 2022] GET /compute/v2.1/servers/88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda => generated 1740 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 23:06:36.002379 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-8ea625b1-9c2b-46c3-a426-d6165c184942 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:06:36.003559 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-8ea625b1-9c2b-46c3-a426-d6165c184942 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] [instance: bf5049e3-3446-468a-a334-d87825e50af4] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:06:36.016743 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-8ea625b1-9c2b-46c3-a426-d6165c184942 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:36.018878 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-8ea625b1-9c2b-46c3-a426-d6165c184942 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:36.019700 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-8ea625b1-9c2b-46c3-a426-d6165c184942 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:36.020404 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-8ea625b1-9c2b-46c3-a426-d6165c184942 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:36.342076 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-aa7a012c-ebfd-4593-b3d8-7a4645596d2b tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e40b7f3da047fcbea943e7f1206bcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee581f47a5419098d02102081f617d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:06:36.351241 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-aa7a012c-ebfd-4593-b3d8-7a4645596d2b tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] 10.222.0.17 "GET /compute/v2.1/servers/97545521-e12e-4dba-b601-3ba8b4c01e17" status: 200 len: 1314 microversion: 2.1 time: 0.390903 Jun 16 23:06:36.351825 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 407/817] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:06:35 2022] GET /compute/v2.1/servers/97545521-e12e-4dba-b601-3ba8b4c01e17 => generated 1314 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:06:36.372692 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-8ea625b1-9c2b-46c3-a426-d6165c184942 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2697aa77265e4f5783f87ffb3d4992b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1423c05c42b14519b401e22e16062781', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:06:36.380831 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-8ea625b1-9c2b-46c3-a426-d6165c184942 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] 10.222.0.17 "GET /compute/v2.1/servers/bf5049e3-3446-468a-a334-d87825e50af4" status: 200 len: 1453 microversion: 2.1 time: 0.387921 Jun 16 23:06:36.381590 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 411/818] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:06:35 2022] GET /compute/v2.1/servers/bf5049e3-3446-468a-a334-d87825e50af4 => generated 1453 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:06:36.793438 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [req-ddde4909-9d78-4929-81fa-c7dfe45393d7 req-8533c61b-be24-479f-9544-de0fc6d0217f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97545521-e12e-4dba-b601-3ba8b4c01e17", "tag": "5940ce61-99be-408d-aa94-28b16beb0ec2"}]} {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 23:06:36.815226 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-ddde4909-9d78-4929-81fa-c7dfe45393d7 req-8533c61b-be24-479f-9544-de0fc6d0217f service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:36.817069 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-ddde4909-9d78-4929-81fa-c7dfe45393d7 req-8533c61b-be24-479f-9544-de0fc6d0217f service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:36.851543 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.compute.server_external_events [req-ddde4909-9d78-4929-81fa-c7dfe45393d7 req-8533c61b-be24-479f-9544-de0fc6d0217f service nova] Creating event network-changed:5940ce61-99be-408d-aa94-28b16beb0ec2 for instance 97545521-e12e-4dba-b601-3ba8b4c01e17 on hv-cinder-84623 Jun 16 23:06:36.857395 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [req-ddde4909-9d78-4929-81fa-c7dfe45393d7 req-8533c61b-be24-479f-9544-de0fc6d0217f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068505 Jun 16 23:06:36.860349 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 408/819] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 23:06:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 23:06:36.999124 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-a06545fe-157e-46bb-a95b-076bb4a6dfdd tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:06:37.000399 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-a06545fe-157e-46bb-a95b-076bb4a6dfdd tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:06:37.011157 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-a06545fe-157e-46bb-a95b-076bb4a6dfdd tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:37.014894 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-a06545fe-157e-46bb-a95b-076bb4a6dfdd tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:37.018097 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-a06545fe-157e-46bb-a95b-076bb4a6dfdd tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:37.021367 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-a06545fe-157e-46bb-a95b-076bb4a6dfdd tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:37.387890 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-54405058-8276-4815-a6e7-57a9c4e4d4af tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:06:37.393285 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-54405058-8276-4815-a6e7-57a9c4e4d4af tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] [instance: 97545521-e12e-4dba-b601-3ba8b4c01e17] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:06:37.399314 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-a06545fe-157e-46bb-a95b-076bb4a6dfdd tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:06:37.408651 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-a06545fe-157e-46bb-a95b-076bb4a6dfdd tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:06:37.410586 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-a06545fe-157e-46bb-a95b-076bb4a6dfdd tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:06:37.412087 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-a06545fe-157e-46bb-a95b-076bb4a6dfdd tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "GET /compute/v2.1/servers/88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda" status: 200 len: 1740 microversion: 2.20 time: 0.418649 Jun 16 23:06:37.412969 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 412/820] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 23:06:36 2022] GET /compute/v2.1/servers/88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda => generated 1740 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 23:06:37.423157 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-54405058-8276-4815-a6e7-57a9c4e4d4af tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:37.423157 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-54405058-8276-4815-a6e7-57a9c4e4d4af tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:37.423157 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-54405058-8276-4815-a6e7-57a9c4e4d4af tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:37.423157 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-54405058-8276-4815-a6e7-57a9c4e4d4af tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:37.614636 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-54405058-8276-4815-a6e7-57a9c4e4d4af tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e40b7f3da047fcbea943e7f1206bcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee581f47a5419098d02102081f617d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:06:37.618139 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG dbcounter [-] [117563] Writing DB stats nova_cell1:SELECT=100 {{(pid=117563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 23:06:37.624199 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-54405058-8276-4815-a6e7-57a9c4e4d4af tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] 10.222.0.17 "GET /compute/v2.1/servers/97545521-e12e-4dba-b601-3ba8b4c01e17" status: 200 len: 1314 microversion: 2.1 time: 0.254645 Jun 16 23:06:37.625014 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 409/821] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:06:37 2022] GET /compute/v2.1/servers/97545521-e12e-4dba-b601-3ba8b4c01e17 => generated 1314 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:06:38.430913 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-315cbd22-6466-4c93-aeee-d123afd78ce2 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:06:38.431527 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-315cbd22-6466-4c93-aeee-d123afd78ce2 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:06:38.441877 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-315cbd22-6466-4c93-aeee-d123afd78ce2 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:38.442477 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-315cbd22-6466-4c93-aeee-d123afd78ce2 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:38.443729 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-315cbd22-6466-4c93-aeee-d123afd78ce2 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:38.444409 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-315cbd22-6466-4c93-aeee-d123afd78ce2 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:38.640808 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-b469ee56-ad89-4e43-802d-b4d5831f2cb3 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:06:38.642357 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-b469ee56-ad89-4e43-802d-b4d5831f2cb3 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] [instance: 97545521-e12e-4dba-b601-3ba8b4c01e17] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:06:38.665068 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-b469ee56-ad89-4e43-802d-b4d5831f2cb3 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:38.665907 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-b469ee56-ad89-4e43-802d-b4d5831f2cb3 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:38.672179 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-b469ee56-ad89-4e43-802d-b4d5831f2cb3 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:38.672961 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-b469ee56-ad89-4e43-802d-b4d5831f2cb3 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:38.701139 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-315cbd22-6466-4c93-aeee-d123afd78ce2 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:06:38.718123 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-315cbd22-6466-4c93-aeee-d123afd78ce2 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:06:38.720127 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-315cbd22-6466-4c93-aeee-d123afd78ce2 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:06:38.721703 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-315cbd22-6466-4c93-aeee-d123afd78ce2 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "GET /compute/v2.1/servers/88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda" status: 200 len: 1740 microversion: 2.20 time: 0.294737 Jun 16 23:06:38.722451 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 413/822] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 23:06:38 2022] GET /compute/v2.1/servers/88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda => generated 1740 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 23:06:38.731999 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [req-f9cf7819-3f17-4a4b-9b85-e289b4e69a13 req-725c318d-ab5e-4d48-bf62-ad2c4f0ba9c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf5049e3-3446-468a-a334-d87825e50af4", "tag": "bee8d2e1-8544-499c-8311-99767df2181b"}]} {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 23:06:38.745705 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [req-f9cf7819-3f17-4a4b-9b85-e289b4e69a13 req-725c318d-ab5e-4d48-bf62-ad2c4f0ba9c4 service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:38.746987 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [req-f9cf7819-3f17-4a4b-9b85-e289b4e69a13 req-725c318d-ab5e-4d48-bf62-ad2c4f0ba9c4 service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:38.765240 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.compute.server_external_events [req-f9cf7819-3f17-4a4b-9b85-e289b4e69a13 req-725c318d-ab5e-4d48-bf62-ad2c4f0ba9c4 service nova] Creating event network-changed:bee8d2e1-8544-499c-8311-99767df2181b for instance bf5049e3-3446-468a-a334-d87825e50af4 on hv-cinder-84623 Jun 16 23:06:38.772513 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [req-f9cf7819-3f17-4a4b-9b85-e289b4e69a13 req-725c318d-ab5e-4d48-bf62-ad2c4f0ba9c4 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044411 Jun 16 23:06:38.773921 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 414/823] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 23:06:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 23:06:39.039312 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-b469ee56-ad89-4e43-802d-b4d5831f2cb3 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e40b7f3da047fcbea943e7f1206bcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee581f47a5419098d02102081f617d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:06:39.048881 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-b469ee56-ad89-4e43-802d-b4d5831f2cb3 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] 10.222.0.17 "GET /compute/v2.1/servers/97545521-e12e-4dba-b601-3ba8b4c01e17" status: 200 len: 1314 microversion: 2.1 time: 0.411816 Jun 16 23:06:39.060071 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 410/824] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:06:38 2022] GET /compute/v2.1/servers/97545521-e12e-4dba-b601-3ba8b4c01e17 => generated 1314 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:06:39.741965 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-8b5ab077-1a67-4a13-b993-5ae6b6ed96a0 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:06:39.742940 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-8b5ab077-1a67-4a13-b993-5ae6b6ed96a0 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:06:39.750653 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-8b5ab077-1a67-4a13-b993-5ae6b6ed96a0 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:39.751111 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-8b5ab077-1a67-4a13-b993-5ae6b6ed96a0 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:39.751910 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-8b5ab077-1a67-4a13-b993-5ae6b6ed96a0 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:39.752348 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-8b5ab077-1a67-4a13-b993-5ae6b6ed96a0 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:39.903930 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-8b5ab077-1a67-4a13-b993-5ae6b6ed96a0 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:06:39.914055 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-8b5ab077-1a67-4a13-b993-5ae6b6ed96a0 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:06:39.915713 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-8b5ab077-1a67-4a13-b993-5ae6b6ed96a0 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:06:39.917202 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-8b5ab077-1a67-4a13-b993-5ae6b6ed96a0 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "GET /compute/v2.1/servers/88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda" status: 200 len: 1740 microversion: 2.20 time: 0.180059 Jun 16 23:06:39.917764 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 415/825] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 23:06:39 2022] GET /compute/v2.1/servers/88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda => generated 1740 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 23:06:40.068555 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-974f1a8d-bb70-4078-bd76-77a07e7df82b tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:06:40.070231 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-974f1a8d-bb70-4078-bd76-77a07e7df82b tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] [instance: 97545521-e12e-4dba-b601-3ba8b4c01e17] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:06:40.078875 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-974f1a8d-bb70-4078-bd76-77a07e7df82b tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:40.079575 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-974f1a8d-bb70-4078-bd76-77a07e7df82b tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:40.080365 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-974f1a8d-bb70-4078-bd76-77a07e7df82b tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:40.080816 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-974f1a8d-bb70-4078-bd76-77a07e7df82b tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:40.262097 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-974f1a8d-bb70-4078-bd76-77a07e7df82b tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e40b7f3da047fcbea943e7f1206bcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee581f47a5419098d02102081f617d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:06:40.271471 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-974f1a8d-bb70-4078-bd76-77a07e7df82b tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] 10.222.0.17 "GET /compute/v2.1/servers/97545521-e12e-4dba-b601-3ba8b4c01e17" status: 200 len: 1314 microversion: 2.1 time: 0.209387 Jun 16 23:06:40.272319 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 411/826] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:06:40 2022] GET /compute/v2.1/servers/97545521-e12e-4dba-b601-3ba8b4c01e17 => generated 1314 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:06:40.939195 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-13073449-42b0-44a2-a7c0-f5a5b0512413 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:06:40.939737 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-13073449-42b0-44a2-a7c0-f5a5b0512413 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:06:40.946221 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-13073449-42b0-44a2-a7c0-f5a5b0512413 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:40.946709 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-13073449-42b0-44a2-a7c0-f5a5b0512413 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:40.947482 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-13073449-42b0-44a2-a7c0-f5a5b0512413 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:40.947929 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-13073449-42b0-44a2-a7c0-f5a5b0512413 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:41.081231 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-13073449-42b0-44a2-a7c0-f5a5b0512413 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:06:41.089081 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-13073449-42b0-44a2-a7c0-f5a5b0512413 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:06:41.090578 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-13073449-42b0-44a2-a7c0-f5a5b0512413 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:06:41.091752 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-13073449-42b0-44a2-a7c0-f5a5b0512413 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "GET /compute/v2.1/servers/88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda" status: 200 len: 1740 microversion: 2.20 time: 0.156575 Jun 16 23:06:41.092828 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 416/827] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 23:06:40 2022] GET /compute/v2.1/servers/88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda => generated 1740 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 23:06:41.289000 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-6d66b6db-573e-41e6-9f9b-34f58b107a1e tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:06:41.289805 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-6d66b6db-573e-41e6-9f9b-34f58b107a1e tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] [instance: 97545521-e12e-4dba-b601-3ba8b4c01e17] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:06:41.296901 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-6d66b6db-573e-41e6-9f9b-34f58b107a1e tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:41.297347 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-6d66b6db-573e-41e6-9f9b-34f58b107a1e tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:41.298112 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-6d66b6db-573e-41e6-9f9b-34f58b107a1e tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:41.298542 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-6d66b6db-573e-41e6-9f9b-34f58b107a1e tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:41.426735 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-6d66b6db-573e-41e6-9f9b-34f58b107a1e tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e40b7f3da047fcbea943e7f1206bcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee581f47a5419098d02102081f617d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:06:41.434117 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-6d66b6db-573e-41e6-9f9b-34f58b107a1e tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] 10.222.0.17 "GET /compute/v2.1/servers/97545521-e12e-4dba-b601-3ba8b4c01e17" status: 200 len: 1314 microversion: 2.1 time: 0.148886 Jun 16 23:06:41.444722 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 412/828] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:06:41 2022] GET /compute/v2.1/servers/97545521-e12e-4dba-b601-3ba8b4c01e17 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:06:42.110817 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-e2a8d48d-a623-47c2-9536-0e914a470e21 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:06:42.111433 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-e2a8d48d-a623-47c2-9536-0e914a470e21 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:06:42.117911 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-e2a8d48d-a623-47c2-9536-0e914a470e21 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:42.118368 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-e2a8d48d-a623-47c2-9536-0e914a470e21 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:42.119178 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-e2a8d48d-a623-47c2-9536-0e914a470e21 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:42.119622 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-e2a8d48d-a623-47c2-9536-0e914a470e21 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:42.250484 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-e2a8d48d-a623-47c2-9536-0e914a470e21 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:06:42.252863 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG dbcounter [-] [117562] Writing DB stats nova_cell1:SELECT=100 {{(pid=117562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 23:06:42.260706 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-e2a8d48d-a623-47c2-9536-0e914a470e21 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:06:42.262213 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-e2a8d48d-a623-47c2-9536-0e914a470e21 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:06:42.263383 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-e2a8d48d-a623-47c2-9536-0e914a470e21 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "GET /compute/v2.1/servers/88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda" status: 200 len: 1722 microversion: 2.20 time: 0.157098 Jun 16 23:06:42.264602 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 417/829] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 23:06:42 2022] GET /compute/v2.1/servers/88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 23:06:42.451902 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-35321e89-1fbe-4e10-b8ae-fca71053eb8a tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:06:42.452462 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-35321e89-1fbe-4e10-b8ae-fca71053eb8a tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] [instance: 97545521-e12e-4dba-b601-3ba8b4c01e17] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:06:42.459036 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-35321e89-1fbe-4e10-b8ae-fca71053eb8a tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:42.459479 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-35321e89-1fbe-4e10-b8ae-fca71053eb8a tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:42.460234 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-35321e89-1fbe-4e10-b8ae-fca71053eb8a tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:42.460665 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-35321e89-1fbe-4e10-b8ae-fca71053eb8a tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:42.586279 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-35321e89-1fbe-4e10-b8ae-fca71053eb8a tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e40b7f3da047fcbea943e7f1206bcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee581f47a5419098d02102081f617d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:06:42.593541 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-35321e89-1fbe-4e10-b8ae-fca71053eb8a tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] 10.222.0.17 "GET /compute/v2.1/servers/97545521-e12e-4dba-b601-3ba8b4c01e17" status: 200 len: 1314 microversion: 2.1 time: 0.146050 Jun 16 23:06:42.594104 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 413/830] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:06:42 2022] GET /compute/v2.1/servers/97545521-e12e-4dba-b601-3ba8b4c01e17 => generated 1314 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:06:43.282016 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-1002afaa-4d92-4d99-a974-6e2005b720aa tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:06:43.282636 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-1002afaa-4d92-4d99-a974-6e2005b720aa tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:06:43.284487 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG dbcounter [-] [117562] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=3 {{(pid=117562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 23:06:43.289940 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-1002afaa-4d92-4d99-a974-6e2005b720aa tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:43.290392 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-1002afaa-4d92-4d99-a974-6e2005b720aa tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:43.291202 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-1002afaa-4d92-4d99-a974-6e2005b720aa tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:43.291641 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-1002afaa-4d92-4d99-a974-6e2005b720aa tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:43.425423 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-1002afaa-4d92-4d99-a974-6e2005b720aa tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:06:43.433841 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-1002afaa-4d92-4d99-a974-6e2005b720aa tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:06:43.435365 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-1002afaa-4d92-4d99-a974-6e2005b720aa tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:06:43.436512 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-1002afaa-4d92-4d99-a974-6e2005b720aa tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "GET /compute/v2.1/servers/88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda" status: 200 len: 1722 microversion: 2.20 time: 0.158494 Jun 16 23:06:43.437066 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 418/831] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 23:06:43 2022] GET /compute/v2.1/servers/88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 23:06:43.610074 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-88b40d15-b8ca-4d92-a72b-76da611862e9 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:06:43.610845 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-88b40d15-b8ca-4d92-a72b-76da611862e9 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] [instance: 97545521-e12e-4dba-b601-3ba8b4c01e17] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:06:43.613597 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG dbcounter [-] [117563] Writing DB stats nova_cell0:SELECT=2 {{(pid=117563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 23:06:43.614345 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG dbcounter [-] [117563] Writing DB stats nova_cell0:SELECT=6 {{(pid=117563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 23:06:43.622134 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-88b40d15-b8ca-4d92-a72b-76da611862e9 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:43.622608 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-88b40d15-b8ca-4d92-a72b-76da611862e9 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:43.623395 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-88b40d15-b8ca-4d92-a72b-76da611862e9 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:43.623841 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-88b40d15-b8ca-4d92-a72b-76da611862e9 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:43.765148 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-88b40d15-b8ca-4d92-a72b-76da611862e9 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e40b7f3da047fcbea943e7f1206bcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee581f47a5419098d02102081f617d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:06:43.772556 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-88b40d15-b8ca-4d92-a72b-76da611862e9 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] 10.222.0.17 "GET /compute/v2.1/servers/97545521-e12e-4dba-b601-3ba8b4c01e17" status: 200 len: 1314 microversion: 2.1 time: 0.167287 Jun 16 23:06:43.782125 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 414/832] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:06:43 2022] GET /compute/v2.1/servers/97545521-e12e-4dba-b601-3ba8b4c01e17 => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:06:43.801944 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [req-bb807ef3-8bef-4030-8432-ee4de34442c0 req-6f5b7c23-caf3-400c-8e39-d62c5f80d7b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97545521-e12e-4dba-b601-3ba8b4c01e17", "name": "network-vif-plugged", "status": "completed", "tag": "5940ce61-99be-408d-aa94-28b16beb0ec2"}]} {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 23:06:43.805401 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG dbcounter [-] [117562] Writing DB stats nova_cell0:SELECT=2 {{(pid=117562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 23:06:43.811593 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [req-bb807ef3-8bef-4030-8432-ee4de34442c0 req-6f5b7c23-caf3-400c-8e39-d62c5f80d7b3 service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:43.812044 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [req-bb807ef3-8bef-4030-8432-ee4de34442c0 req-6f5b7c23-caf3-400c-8e39-d62c5f80d7b3 service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:43.822845 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.compute.server_external_events [req-bb807ef3-8bef-4030-8432-ee4de34442c0 req-6f5b7c23-caf3-400c-8e39-d62c5f80d7b3 service nova] Creating event network-vif-plugged:5940ce61-99be-408d-aa94-28b16beb0ec2 for instance 97545521-e12e-4dba-b601-3ba8b4c01e17 on hv-cinder-84623 Jun 16 23:06:43.828353 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [req-bb807ef3-8bef-4030-8432-ee4de34442c0 req-6f5b7c23-caf3-400c-8e39-d62c5f80d7b3 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030045 Jun 16 23:06:43.829193 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 419/833] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 23:06:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 23:06:44.454978 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-70065b48-bfc3-4ac8-9bf0-7ec074db13d8 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:06:44.455515 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-70065b48-bfc3-4ac8-9bf0-7ec074db13d8 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:06:44.461576 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-70065b48-bfc3-4ac8-9bf0-7ec074db13d8 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:44.462032 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-70065b48-bfc3-4ac8-9bf0-7ec074db13d8 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:44.462830 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-70065b48-bfc3-4ac8-9bf0-7ec074db13d8 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:44.463271 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-70065b48-bfc3-4ac8-9bf0-7ec074db13d8 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:44.586880 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-70065b48-bfc3-4ac8-9bf0-7ec074db13d8 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:06:44.595258 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-70065b48-bfc3-4ac8-9bf0-7ec074db13d8 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:06:44.596757 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-70065b48-bfc3-4ac8-9bf0-7ec074db13d8 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:06:44.597912 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-70065b48-bfc3-4ac8-9bf0-7ec074db13d8 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "GET /compute/v2.1/servers/88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda" status: 200 len: 1665 microversion: 2.20 time: 0.147694 Jun 16 23:06:44.598465 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 415/834] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 23:06:44 2022] GET /compute/v2.1/servers/88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda => generated 1665 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 23:06:44.616069 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-632c5ac2-4bdc-4209-a032-8c238bc01e6d tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "108aa182-a973-4a1b-ba8b-cf95bf9cd6f8"}} {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 23:06:44.617198 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-632c5ac2-4bdc-4209-a032-8c238bc01e6d tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:06:44.623478 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-632c5ac2-4bdc-4209-a032-8c238bc01e6d tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:44.623928 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-632c5ac2-4bdc-4209-a032-8c238bc01e6d tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:44.624689 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-632c5ac2-4bdc-4209-a032-8c238bc01e6d tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:44.625127 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-632c5ac2-4bdc-4209-a032-8c238bc01e6d tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:44.789565 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-79eb088b-2ba1-40d8-9cfe-9d87077ba42f tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:06:44.790185 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-79eb088b-2ba1-40d8-9cfe-9d87077ba42f tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] [instance: 97545521-e12e-4dba-b601-3ba8b4c01e17] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:06:44.797223 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-79eb088b-2ba1-40d8-9cfe-9d87077ba42f tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:44.797681 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-79eb088b-2ba1-40d8-9cfe-9d87077ba42f tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:44.798453 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-79eb088b-2ba1-40d8-9cfe-9d87077ba42f tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:44.798927 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-79eb088b-2ba1-40d8-9cfe-9d87077ba42f tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:44.904657 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-632c5ac2-4bdc-4209-a032-8c238bc01e6d tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "POST /compute/v2.1/servers/88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.293301 Jun 16 23:06:44.905282 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 420/835] 10.222.0.17 () {62 vars in 1363 bytes} [Thu Jun 16 23:06:44 2022] POST /compute/v2.1/servers/88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda/os-volume_attachments => generated 188 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 16 23:06:44.935079 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-79eb088b-2ba1-40d8-9cfe-9d87077ba42f tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e40b7f3da047fcbea943e7f1206bcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee581f47a5419098d02102081f617d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:06:44.943107 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-79eb088b-2ba1-40d8-9cfe-9d87077ba42f tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] 10.222.0.17 "GET /compute/v2.1/servers/97545521-e12e-4dba-b601-3ba8b4c01e17" status: 200 len: 1314 microversion: 2.1 time: 0.157552 Jun 16 23:06:44.943604 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 416/836] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:06:44 2022] GET /compute/v2.1/servers/97545521-e12e-4dba-b601-3ba8b4c01e17 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 23:06:45.019145 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-c5433646-db75-495b-a004-f1ef2c04b75b tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:06:45.019674 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-c5433646-db75-495b-a004-f1ef2c04b75b tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:06:45.026283 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-c5433646-db75-495b-a004-f1ef2c04b75b tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:45.026846 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-c5433646-db75-495b-a004-f1ef2c04b75b tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:45.027617 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-c5433646-db75-495b-a004-f1ef2c04b75b tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:45.028062 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-c5433646-db75-495b-a004-f1ef2c04b75b tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:45.257834 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-c5433646-db75-495b-a004-f1ef2c04b75b tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "DELETE /compute/v2.1/servers/88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda/os-volume_attachments/108aa182-a973-4a1b-ba8b-cf95bf9cd6f8" status: 202 len: 0 microversion: 2.20 time: 0.242530 Jun 16 23:06:45.258417 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 421/837] 10.222.0.17 () {60 vars in 1456 bytes} [Thu Jun 16 23:06:45 2022] DELETE /compute/v2.1/servers/88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda/os-volume_attachments/108aa182-a973-4a1b-ba8b-cf95bf9cd6f8 => generated 0 bytes in 244 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 16 23:06:45.312455 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-548bc06b-9629-481d-8b14-de48facc89cc tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 23:06:45.313015 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-548bc06b-9629-481d-8b14-de48facc89cc tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:06:45.319000 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-548bc06b-9629-481d-8b14-de48facc89cc tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:45.319451 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-548bc06b-9629-481d-8b14-de48facc89cc tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:45.320236 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-548bc06b-9629-481d-8b14-de48facc89cc tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:45.320672 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-548bc06b-9629-481d-8b14-de48facc89cc tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:45.411767 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-548bc06b-9629-481d-8b14-de48facc89cc tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "POST /compute/v2.1/servers/88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda/action" status: 202 len: 0 microversion: 2.20 time: 0.103309 Jun 16 23:06:45.412376 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 417/838] 10.222.0.17 () {62 vars in 1318 bytes} [Thu Jun 16 23:06:45 2022] POST /compute/v2.1/servers/88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda/action => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 16 23:06:45.420894 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-984fa174-41f7-4d60-af40-323b722b590b tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:06:45.421631 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-984fa174-41f7-4d60-af40-323b722b590b tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:06:45.427618 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-984fa174-41f7-4d60-af40-323b722b590b tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:45.428068 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-984fa174-41f7-4d60-af40-323b722b590b tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:45.428827 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-984fa174-41f7-4d60-af40-323b722b590b tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:45.429264 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-984fa174-41f7-4d60-af40-323b722b590b tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:45.569262 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-984fa174-41f7-4d60-af40-323b722b590b tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:06:45.578229 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-984fa174-41f7-4d60-af40-323b722b590b tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:06:45.580099 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-984fa174-41f7-4d60-af40-323b722b590b tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:06:45.581329 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-984fa174-41f7-4d60-af40-323b722b590b tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "GET /compute/v2.1/servers/88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda" status: 200 len: 1673 microversion: 2.20 time: 0.164740 Jun 16 23:06:45.581961 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 422/839] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 23:06:45 2022] GET /compute/v2.1/servers/88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda => generated 1673 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 23:06:45.847186 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [req-dfee427a-547a-48a3-b8a6-975806eaf49e req-b3ed6aca-2692-478c-8813-9953168d2d70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda", "name": "network-vif-unplugged", "status": "completed", "tag": "4b3b90f0-95df-4c59-9186-169416370496"}]} {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 23:06:45.855935 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-dfee427a-547a-48a3-b8a6-975806eaf49e req-b3ed6aca-2692-478c-8813-9953168d2d70 service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:45.856412 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-dfee427a-547a-48a3-b8a6-975806eaf49e req-b3ed6aca-2692-478c-8813-9953168d2d70 service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:45.868020 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.compute.server_external_events [req-dfee427a-547a-48a3-b8a6-975806eaf49e req-b3ed6aca-2692-478c-8813-9953168d2d70 service nova] Unable to find a host for instance 88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda. Dropping event network-vif-unplugged {{(pid=117563) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 16 23:06:45.868872 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [req-dfee427a-547a-48a3-b8a6-975806eaf49e req-b3ed6aca-2692-478c-8813-9953168d2d70 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.026304 Jun 16 23:06:45.869449 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 418/840] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 23:06:45 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 27 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jun 16 23:06:45.959938 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-09237bfb-0b89-4f4a-8f3c-7690b825bd27 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:06:45.960540 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-09237bfb-0b89-4f4a-8f3c-7690b825bd27 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] [instance: 97545521-e12e-4dba-b601-3ba8b4c01e17] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:06:45.967265 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-09237bfb-0b89-4f4a-8f3c-7690b825bd27 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:45.967715 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-09237bfb-0b89-4f4a-8f3c-7690b825bd27 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:45.968486 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-09237bfb-0b89-4f4a-8f3c-7690b825bd27 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:45.968918 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-09237bfb-0b89-4f4a-8f3c-7690b825bd27 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:46.136515 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-09237bfb-0b89-4f4a-8f3c-7690b825bd27 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e40b7f3da047fcbea943e7f1206bcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee581f47a5419098d02102081f617d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:06:46.144681 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-09237bfb-0b89-4f4a-8f3c-7690b825bd27 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] 10.222.0.17 "GET /compute/v2.1/servers/97545521-e12e-4dba-b601-3ba8b4c01e17" status: 200 len: 1498 microversion: 2.1 time: 0.188461 Jun 16 23:06:46.145376 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 423/841] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:06:45 2022] GET /compute/v2.1/servers/97545521-e12e-4dba-b601-3ba8b4c01e17 => generated 1498 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:06:46.572679 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-6c35a235-9a42-4db1-a834-fcf378bddd23 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:06:46.573088 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-6c35a235-9a42-4db1-a834-fcf378bddd23 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] [instance: 97545521-e12e-4dba-b601-3ba8b4c01e17] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:06:46.579552 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-6c35a235-9a42-4db1-a834-fcf378bddd23 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:46.580029 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-6c35a235-9a42-4db1-a834-fcf378bddd23 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:46.580799 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-6c35a235-9a42-4db1-a834-fcf378bddd23 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:46.581237 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-6c35a235-9a42-4db1-a834-fcf378bddd23 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:46.600152 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-9591b89a-c98d-4c7c-938a-3bf00f516bc6 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:06:46.601123 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-9591b89a-c98d-4c7c-938a-3bf00f516bc6 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:06:46.607933 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-9591b89a-c98d-4c7c-938a-3bf00f516bc6 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:46.608100 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-6c35a235-9a42-4db1-a834-fcf378bddd23 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] [instance: 97545521-e12e-4dba-b601-3ba8b4c01e17] Going to try to terminate instance {{(pid=117563) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 23:06:46.608394 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-9591b89a-c98d-4c7c-938a-3bf00f516bc6 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:46.609257 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-9591b89a-c98d-4c7c-938a-3bf00f516bc6 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:46.609782 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-9591b89a-c98d-4c7c-938a-3bf00f516bc6 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:46.694898 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-6c35a235-9a42-4db1-a834-fcf378bddd23 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] 10.222.0.17 "DELETE /compute/v2.1/servers/97545521-e12e-4dba-b601-3ba8b4c01e17" status: 204 len: 0 microversion: 2.1 time: 0.125999 Jun 16 23:06:46.696440 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 419/842] 10.222.0.17 () {58 vars in 1238 bytes} [Thu Jun 16 23:06:46 2022] DELETE /compute/v2.1/servers/97545521-e12e-4dba-b601-3ba8b4c01e17 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 23:06:46.706924 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-57a088c5-613e-4b7d-b825-597b9c87af57 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:06:46.707872 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-57a088c5-613e-4b7d-b825-597b9c87af57 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] [instance: 97545521-e12e-4dba-b601-3ba8b4c01e17] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:06:46.714026 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-57a088c5-613e-4b7d-b825-597b9c87af57 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:46.714483 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-57a088c5-613e-4b7d-b825-597b9c87af57 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:46.715296 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-57a088c5-613e-4b7d-b825-597b9c87af57 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:46.715739 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-57a088c5-613e-4b7d-b825-597b9c87af57 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:46.751930 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-9591b89a-c98d-4c7c-938a-3bf00f516bc6 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:06:46.760316 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-9591b89a-c98d-4c7c-938a-3bf00f516bc6 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:06:46.761805 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-9591b89a-c98d-4c7c-938a-3bf00f516bc6 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:06:46.762981 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-9591b89a-c98d-4c7c-938a-3bf00f516bc6 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "GET /compute/v2.1/servers/88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda" status: 200 len: 1673 microversion: 2.20 time: 0.166880 Jun 16 23:06:46.764074 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 424/843] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 23:06:46 2022] GET /compute/v2.1/servers/88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda => generated 1673 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 23:06:46.850498 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-57a088c5-613e-4b7d-b825-597b9c87af57 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e40b7f3da047fcbea943e7f1206bcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee581f47a5419098d02102081f617d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:06:46.857964 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-57a088c5-613e-4b7d-b825-597b9c87af57 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] 10.222.0.17 "GET /compute/v2.1/servers/97545521-e12e-4dba-b601-3ba8b4c01e17" status: 200 len: 1504 microversion: 2.1 time: 0.156031 Jun 16 23:06:46.858520 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 420/844] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:06:46 2022] GET /compute/v2.1/servers/97545521-e12e-4dba-b601-3ba8b4c01e17 => generated 1504 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 23:06:47.782372 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-b0a60a12-5a18-43b2-85e8-991e763cb419 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:06:47.783021 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-b0a60a12-5a18-43b2-85e8-991e763cb419 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:06:47.789538 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-b0a60a12-5a18-43b2-85e8-991e763cb419 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:47.789991 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-b0a60a12-5a18-43b2-85e8-991e763cb419 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:47.790794 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-b0a60a12-5a18-43b2-85e8-991e763cb419 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:47.791234 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-b0a60a12-5a18-43b2-85e8-991e763cb419 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:47.875247 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-ca55fde5-ebeb-4747-adfe-0d139e62ec07 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:06:47.875861 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-ca55fde5-ebeb-4747-adfe-0d139e62ec07 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] [instance: 97545521-e12e-4dba-b601-3ba8b4c01e17] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:06:47.882450 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-ca55fde5-ebeb-4747-adfe-0d139e62ec07 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:47.882866 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-ca55fde5-ebeb-4747-adfe-0d139e62ec07 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:47.883639 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-ca55fde5-ebeb-4747-adfe-0d139e62ec07 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:47.884078 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-ca55fde5-ebeb-4747-adfe-0d139e62ec07 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:47.918086 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-b0a60a12-5a18-43b2-85e8-991e763cb419 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:06:47.926465 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-b0a60a12-5a18-43b2-85e8-991e763cb419 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:06:47.928095 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-b0a60a12-5a18-43b2-85e8-991e763cb419 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:06:47.929337 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-b0a60a12-5a18-43b2-85e8-991e763cb419 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "GET /compute/v2.1/servers/88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda" status: 200 len: 1731 microversion: 2.20 time: 0.151641 Jun 16 23:06:47.929969 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 425/845] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 23:06:47 2022] GET /compute/v2.1/servers/88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda => generated 1731 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 23:06:48.019971 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-ca55fde5-ebeb-4747-adfe-0d139e62ec07 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e40b7f3da047fcbea943e7f1206bcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee581f47a5419098d02102081f617d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:06:48.027901 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-ca55fde5-ebeb-4747-adfe-0d139e62ec07 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] 10.222.0.17 "GET /compute/v2.1/servers/97545521-e12e-4dba-b601-3ba8b4c01e17" status: 200 len: 1504 microversion: 2.1 time: 0.156982 Jun 16 23:06:48.028465 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 421/846] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:06:47 2022] GET /compute/v2.1/servers/97545521-e12e-4dba-b601-3ba8b4c01e17 => generated 1504 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 23:06:48.948298 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-b2d73f9a-89f4-432e-994d-2487028014c0 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:06:48.948897 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-b2d73f9a-89f4-432e-994d-2487028014c0 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:06:48.955709 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-b2d73f9a-89f4-432e-994d-2487028014c0 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:48.956155 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-b2d73f9a-89f4-432e-994d-2487028014c0 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:48.956924 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-b2d73f9a-89f4-432e-994d-2487028014c0 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:48.957357 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-b2d73f9a-89f4-432e-994d-2487028014c0 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:49.046000 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-17f6a304-d257-489f-8c3b-c10309a7dbee tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:06:49.047343 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-17f6a304-d257-489f-8c3b-c10309a7dbee tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] [instance: 97545521-e12e-4dba-b601-3ba8b4c01e17] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:06:49.054123 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-17f6a304-d257-489f-8c3b-c10309a7dbee tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:49.054870 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-17f6a304-d257-489f-8c3b-c10309a7dbee tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:49.055695 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-17f6a304-d257-489f-8c3b-c10309a7dbee tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:49.056135 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-17f6a304-d257-489f-8c3b-c10309a7dbee tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:49.175340 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-17f6a304-d257-489f-8c3b-c10309a7dbee tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e40b7f3da047fcbea943e7f1206bcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee581f47a5419098d02102081f617d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:06:49.185736 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-17f6a304-d257-489f-8c3b-c10309a7dbee tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] 10.222.0.17 "GET /compute/v2.1/servers/97545521-e12e-4dba-b601-3ba8b4c01e17" status: 200 len: 1462 microversion: 2.1 time: 0.143516 Jun 16 23:06:49.187095 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 422/847] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:06:49 2022] GET /compute/v2.1/servers/97545521-e12e-4dba-b601-3ba8b4c01e17 => generated 1462 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:06:49.248326 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [req-b151600b-a656-4cf5-8e85-1576d710057f req-d22f88b9-f55e-433e-b0c6-049824fae512 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97545521-e12e-4dba-b601-3ba8b4c01e17", "name": "network-vif-deleted", "tag": "5940ce61-99be-408d-aa94-28b16beb0ec2"}]} {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 23:06:49.255146 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-b2d73f9a-89f4-432e-994d-2487028014c0 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:06:49.261431 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-b151600b-a656-4cf5-8e85-1576d710057f req-d22f88b9-f55e-433e-b0c6-049824fae512 service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:49.262121 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-b151600b-a656-4cf5-8e85-1576d710057f req-d22f88b9-f55e-433e-b0c6-049824fae512 service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:49.264813 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-b2d73f9a-89f4-432e-994d-2487028014c0 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:06:49.266528 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-b2d73f9a-89f4-432e-994d-2487028014c0 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:06:49.268078 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-b2d73f9a-89f4-432e-994d-2487028014c0 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "GET /compute/v2.1/servers/88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda" status: 200 len: 1731 microversion: 2.20 time: 0.323868 Jun 16 23:06:49.268725 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 426/848] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 23:06:48 2022] GET /compute/v2.1/servers/88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda => generated 1731 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 23:06:49.282046 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.compute.server_external_events [req-b151600b-a656-4cf5-8e85-1576d710057f req-d22f88b9-f55e-433e-b0c6-049824fae512 service nova] Creating event network-vif-deleted:5940ce61-99be-408d-aa94-28b16beb0ec2 for instance 97545521-e12e-4dba-b601-3ba8b4c01e17 on hv-cinder-84623 Jun 16 23:06:49.288091 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [req-b151600b-a656-4cf5-8e85-1576d710057f req-d22f88b9-f55e-433e-b0c6-049824fae512 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047155 Jun 16 23:06:49.288683 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 423/849] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 23:06:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 23:06:50.203909 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-b0937986-2122-4cc4-b208-1357fb2817fb tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:06:50.204440 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-b0937986-2122-4cc4-b208-1357fb2817fb tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] [instance: 97545521-e12e-4dba-b601-3ba8b4c01e17] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:06:50.211033 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-b0937986-2122-4cc4-b208-1357fb2817fb tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:50.211481 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-b0937986-2122-4cc4-b208-1357fb2817fb tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:50.212250 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-b0937986-2122-4cc4-b208-1357fb2817fb tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:50.212690 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-b0937986-2122-4cc4-b208-1357fb2817fb tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:50.250615 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-b0937986-2122-4cc4-b208-1357fb2817fb tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:50.251099 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-b0937986-2122-4cc4-b208-1357fb2817fb tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:50.251555 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.objects.instance [None req-b0937986-2122-4cc4-b208-1357fb2817fb tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lazy-loading 'fault' on Instance uuid 97545521-e12e-4dba-b601-3ba8b4c01e17 {{(pid=117562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 23:06:50.289437 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-b25dec38-9d15-4443-bda3-d8264105bd4e tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:06:50.290739 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-b25dec38-9d15-4443-bda3-d8264105bd4e tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:06:50.296903 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-b0937986-2122-4cc4-b208-1357fb2817fb tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e40b7f3da047fcbea943e7f1206bcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee581f47a5419098d02102081f617d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:06:50.305890 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-b0937986-2122-4cc4-b208-1357fb2817fb tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] 10.222.0.17 "GET /compute/v2.1/servers/97545521-e12e-4dba-b601-3ba8b4c01e17" status: 200 len: 1304 microversion: 2.1 time: 0.106608 Jun 16 23:06:50.307356 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 427/850] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:06:50 2022] GET /compute/v2.1/servers/97545521-e12e-4dba-b601-3ba8b4c01e17 => generated 1304 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:06:50.308487 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-b25dec38-9d15-4443-bda3-d8264105bd4e tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:50.309157 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-b25dec38-9d15-4443-bda3-d8264105bd4e tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:50.310546 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-b25dec38-9d15-4443-bda3-d8264105bd4e tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:50.311032 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-b25dec38-9d15-4443-bda3-d8264105bd4e tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:50.461101 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-b25dec38-9d15-4443-bda3-d8264105bd4e tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:06:50.470248 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-b25dec38-9d15-4443-bda3-d8264105bd4e tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:06:50.471867 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-b25dec38-9d15-4443-bda3-d8264105bd4e tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:06:50.473099 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-b25dec38-9d15-4443-bda3-d8264105bd4e tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "GET /compute/v2.1/servers/88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda" status: 200 len: 1731 microversion: 2.20 time: 0.189573 Jun 16 23:06:50.474259 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 424/851] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 23:06:50 2022] GET /compute/v2.1/servers/88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda => generated 1731 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 23:06:51.323323 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-3c6192b2-8e46-403f-8ded-f7adecdf340f tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:06:51.323925 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-3c6192b2-8e46-403f-8ded-f7adecdf340f tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] [instance: 97545521-e12e-4dba-b601-3ba8b4c01e17] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:06:51.331618 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-3c6192b2-8e46-403f-8ded-f7adecdf340f tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:51.332063 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-3c6192b2-8e46-403f-8ded-f7adecdf340f tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:51.333034 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-3c6192b2-8e46-403f-8ded-f7adecdf340f tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:51.333471 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-3c6192b2-8e46-403f-8ded-f7adecdf340f tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:51.368569 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-3c6192b2-8e46-403f-8ded-f7adecdf340f tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:51.369260 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-3c6192b2-8e46-403f-8ded-f7adecdf340f tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:51.369260 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.objects.instance [None req-3c6192b2-8e46-403f-8ded-f7adecdf340f tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lazy-loading 'fault' on Instance uuid 97545521-e12e-4dba-b601-3ba8b4c01e17 {{(pid=117562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 23:06:51.411322 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-3c6192b2-8e46-403f-8ded-f7adecdf340f tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e40b7f3da047fcbea943e7f1206bcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee581f47a5419098d02102081f617d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:06:51.418804 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-3c6192b2-8e46-403f-8ded-f7adecdf340f tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] 10.222.0.17 "GET /compute/v2.1/servers/97545521-e12e-4dba-b601-3ba8b4c01e17" status: 200 len: 1304 microversion: 2.1 time: 0.099243 Jun 16 23:06:51.419353 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 428/852] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:06:51 2022] GET /compute/v2.1/servers/97545521-e12e-4dba-b601-3ba8b4c01e17 => generated 1304 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:06:51.493514 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-6895b39a-2c48-493f-93f5-d45b0e69a4c9 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:06:51.494128 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-6895b39a-2c48-493f-93f5-d45b0e69a4c9 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:06:51.500990 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-6895b39a-2c48-493f-93f5-d45b0e69a4c9 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:51.501439 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-6895b39a-2c48-493f-93f5-d45b0e69a4c9 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:51.502217 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-6895b39a-2c48-493f-93f5-d45b0e69a4c9 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:51.502681 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-6895b39a-2c48-493f-93f5-d45b0e69a4c9 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:51.507045 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG dbcounter [-] [117563] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 23:06:51.639987 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-6895b39a-2c48-493f-93f5-d45b0e69a4c9 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:06:51.648325 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-6895b39a-2c48-493f-93f5-d45b0e69a4c9 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:06:51.649847 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-6895b39a-2c48-493f-93f5-d45b0e69a4c9 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:06:51.651053 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-6895b39a-2c48-493f-93f5-d45b0e69a4c9 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "GET /compute/v2.1/servers/88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda" status: 200 len: 1731 microversion: 2.20 time: 0.161526 Jun 16 23:06:51.651602 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 425/853] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 23:06:51 2022] GET /compute/v2.1/servers/88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda => generated 1731 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 23:06:52.435643 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-cbd25c3a-b521-4c9a-b2b2-cb8166a79183 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:06:52.436278 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-cbd25c3a-b521-4c9a-b2b2-cb8166a79183 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] [instance: 97545521-e12e-4dba-b601-3ba8b4c01e17] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:06:52.442856 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-cbd25c3a-b521-4c9a-b2b2-cb8166a79183 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:52.443313 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-cbd25c3a-b521-4c9a-b2b2-cb8166a79183 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:52.444090 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-cbd25c3a-b521-4c9a-b2b2-cb8166a79183 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:52.444528 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-cbd25c3a-b521-4c9a-b2b2-cb8166a79183 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:52.448752 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG dbcounter [-] [117562] Writing DB stats nova_cell1:SELECT=87,nova_cell1:INSERT=5,nova_cell1:UPDATE=8 {{(pid=117562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 23:06:52.477852 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-cbd25c3a-b521-4c9a-b2b2-cb8166a79183 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:52.478299 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-cbd25c3a-b521-4c9a-b2b2-cb8166a79183 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:52.478781 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.objects.instance [None req-cbd25c3a-b521-4c9a-b2b2-cb8166a79183 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lazy-loading 'fault' on Instance uuid 97545521-e12e-4dba-b601-3ba8b4c01e17 {{(pid=117562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 23:06:52.519619 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-cbd25c3a-b521-4c9a-b2b2-cb8166a79183 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e40b7f3da047fcbea943e7f1206bcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee581f47a5419098d02102081f617d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:06:52.527285 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-cbd25c3a-b521-4c9a-b2b2-cb8166a79183 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] 10.222.0.17 "GET /compute/v2.1/servers/97545521-e12e-4dba-b601-3ba8b4c01e17" status: 200 len: 1304 microversion: 2.1 time: 0.095438 Jun 16 23:06:52.527853 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 429/854] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:06:52 2022] GET /compute/v2.1/servers/97545521-e12e-4dba-b601-3ba8b4c01e17 => generated 1304 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 23:06:52.670162 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-297e8141-d302-4089-94c4-fa5ed81bf63e tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:06:52.670785 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-297e8141-d302-4089-94c4-fa5ed81bf63e tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:06:52.677378 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-297e8141-d302-4089-94c4-fa5ed81bf63e tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:52.677830 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-297e8141-d302-4089-94c4-fa5ed81bf63e tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:52.678773 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-297e8141-d302-4089-94c4-fa5ed81bf63e tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:52.679218 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-297e8141-d302-4089-94c4-fa5ed81bf63e tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:52.823111 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-297e8141-d302-4089-94c4-fa5ed81bf63e tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:06:52.833192 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-297e8141-d302-4089-94c4-fa5ed81bf63e tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:06:52.834931 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-297e8141-d302-4089-94c4-fa5ed81bf63e tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:06:52.836231 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-297e8141-d302-4089-94c4-fa5ed81bf63e tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "GET /compute/v2.1/servers/88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda" status: 200 len: 1731 microversion: 2.20 time: 0.170893 Jun 16 23:06:52.836900 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 426/855] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 23:06:52 2022] GET /compute/v2.1/servers/88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda => generated 1731 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 23:06:52.953609 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-1a84b7bb-1b92-46f5-9596-387e6f526c4b tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:06:52.954104 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-1a84b7bb-1b92-46f5-9596-387e6f526c4b tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] [instance: b7619c39-737f-440b-b676-8e920380d6c6] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:06:52.960362 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-1a84b7bb-1b92-46f5-9596-387e6f526c4b tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:52.960840 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-1a84b7bb-1b92-46f5-9596-387e6f526c4b tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:52.961838 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-1a84b7bb-1b92-46f5-9596-387e6f526c4b tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:52.962425 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-1a84b7bb-1b92-46f5-9596-387e6f526c4b tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:52.987424 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-1a84b7bb-1b92-46f5-9596-387e6f526c4b tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] 10.222.0.17 "GET /compute/v2.1/servers/b7619c39-737f-440b-b676-8e920380d6c6/ips" status: 200 len: 144 microversion: 2.1 time: 0.038261 Jun 16 23:06:52.993351 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 430/856] 10.222.0.17 () {58 vars in 1247 bytes} [Thu Jun 16 23:06:52 2022] GET /compute/v2.1/servers/b7619c39-737f-440b-b676-8e920380d6c6/ips => generated 144 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 23:06:53.546277 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-1e565639-435e-4e7d-9f17-9cd3ae79a9bf tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:06:53.546839 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-1e565639-435e-4e7d-9f17-9cd3ae79a9bf tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] [instance: 97545521-e12e-4dba-b601-3ba8b4c01e17] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:06:53.552827 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-1e565639-435e-4e7d-9f17-9cd3ae79a9bf tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:53.553263 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-1e565639-435e-4e7d-9f17-9cd3ae79a9bf tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:53.554034 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-1e565639-435e-4e7d-9f17-9cd3ae79a9bf tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:53.554479 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-1e565639-435e-4e7d-9f17-9cd3ae79a9bf tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:53.589045 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-1e565639-435e-4e7d-9f17-9cd3ae79a9bf tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:53.589765 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-1e565639-435e-4e7d-9f17-9cd3ae79a9bf tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:53.590410 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.objects.instance [None req-1e565639-435e-4e7d-9f17-9cd3ae79a9bf tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lazy-loading 'fault' on Instance uuid 97545521-e12e-4dba-b601-3ba8b4c01e17 {{(pid=117563) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 23:06:53.636454 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-1e565639-435e-4e7d-9f17-9cd3ae79a9bf tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e40b7f3da047fcbea943e7f1206bcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee581f47a5419098d02102081f617d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:06:53.645691 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-1e565639-435e-4e7d-9f17-9cd3ae79a9bf tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] 10.222.0.17 "GET /compute/v2.1/servers/97545521-e12e-4dba-b601-3ba8b4c01e17" status: 200 len: 1304 microversion: 2.1 time: 0.104860 Jun 16 23:06:53.654131 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 427/857] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:06:53 2022] GET /compute/v2.1/servers/97545521-e12e-4dba-b601-3ba8b4c01e17 => generated 1304 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:06:53.855554 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-15d44afc-7052-4baa-8ca5-c863e2734fae tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:06:53.856839 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-15d44afc-7052-4baa-8ca5-c863e2734fae tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:06:53.863794 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-15d44afc-7052-4baa-8ca5-c863e2734fae tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:53.864330 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-15d44afc-7052-4baa-8ca5-c863e2734fae tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:53.865186 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-15d44afc-7052-4baa-8ca5-c863e2734fae tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:53.865701 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-15d44afc-7052-4baa-8ca5-c863e2734fae tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:54.002090 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-15d44afc-7052-4baa-8ca5-c863e2734fae tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:06:54.011186 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-15d44afc-7052-4baa-8ca5-c863e2734fae tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:06:54.015094 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-15d44afc-7052-4baa-8ca5-c863e2734fae tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:06:54.017099 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-15d44afc-7052-4baa-8ca5-c863e2734fae tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "GET /compute/v2.1/servers/88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda" status: 200 len: 1731 microversion: 2.20 time: 0.165300 Jun 16 23:06:54.017951 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 431/858] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 23:06:53 2022] GET /compute/v2.1/servers/88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda => generated 1731 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 23:06:54.329801 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-6914fb49-d790-4b5f-afcf-ef4019b08ce8 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "456f85b5-0d99-4809-a886-316018a40337"}} {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 23:06:54.330884 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-6914fb49-d790-4b5f-afcf-ef4019b08ce8 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] [instance: b7619c39-737f-440b-b676-8e920380d6c6] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:06:54.337488 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-6914fb49-d790-4b5f-afcf-ef4019b08ce8 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:54.337948 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-6914fb49-d790-4b5f-afcf-ef4019b08ce8 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:54.338806 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-6914fb49-d790-4b5f-afcf-ef4019b08ce8 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:54.339248 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-6914fb49-d790-4b5f-afcf-ef4019b08ce8 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:54.662960 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-31954e88-cc18-4fef-9368-d8f99af425e0 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:06:54.663662 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-31954e88-cc18-4fef-9368-d8f99af425e0 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] [instance: 97545521-e12e-4dba-b601-3ba8b4c01e17] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:06:54.670511 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-31954e88-cc18-4fef-9368-d8f99af425e0 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:54.670990 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-31954e88-cc18-4fef-9368-d8f99af425e0 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:54.671767 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-31954e88-cc18-4fef-9368-d8f99af425e0 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:54.672207 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-31954e88-cc18-4fef-9368-d8f99af425e0 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:54.705898 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-31954e88-cc18-4fef-9368-d8f99af425e0 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:54.706354 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-31954e88-cc18-4fef-9368-d8f99af425e0 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:54.707051 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.objects.instance [None req-31954e88-cc18-4fef-9368-d8f99af425e0 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lazy-loading 'fault' on Instance uuid 97545521-e12e-4dba-b601-3ba8b4c01e17 {{(pid=117562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 23:06:54.751947 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-31954e88-cc18-4fef-9368-d8f99af425e0 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e40b7f3da047fcbea943e7f1206bcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee581f47a5419098d02102081f617d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:06:54.759926 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-31954e88-cc18-4fef-9368-d8f99af425e0 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] 10.222.0.17 "GET /compute/v2.1/servers/97545521-e12e-4dba-b601-3ba8b4c01e17" status: 200 len: 1304 microversion: 2.1 time: 0.100782 Jun 16 23:06:54.769509 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 432/859] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:06:54 2022] GET /compute/v2.1/servers/97545521-e12e-4dba-b601-3ba8b4c01e17 => generated 1304 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 23:06:55.036252 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-145d99f7-45e4-4c6a-8643-acf8e107c896 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:06:55.036922 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-145d99f7-45e4-4c6a-8643-acf8e107c896 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:06:55.044119 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-145d99f7-45e4-4c6a-8643-acf8e107c896 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:55.044573 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-145d99f7-45e4-4c6a-8643-acf8e107c896 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:55.045355 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-145d99f7-45e4-4c6a-8643-acf8e107c896 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:55.045796 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-145d99f7-45e4-4c6a-8643-acf8e107c896 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:55.194888 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-145d99f7-45e4-4c6a-8643-acf8e107c896 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:06:55.203800 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-145d99f7-45e4-4c6a-8643-acf8e107c896 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:06:55.205292 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-145d99f7-45e4-4c6a-8643-acf8e107c896 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:06:55.206449 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-145d99f7-45e4-4c6a-8643-acf8e107c896 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "GET /compute/v2.1/servers/88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda" status: 200 len: 1731 microversion: 2.20 time: 0.174245 Jun 16 23:06:55.207187 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 433/860] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 23:06:55 2022] GET /compute/v2.1/servers/88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda => generated 1731 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 23:06:55.777163 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-5cb65925-7844-4be8-b256-03078dad7ddb tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:06:55.777813 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-5cb65925-7844-4be8-b256-03078dad7ddb tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] [instance: 97545521-e12e-4dba-b601-3ba8b4c01e17] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:06:55.784394 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-5cb65925-7844-4be8-b256-03078dad7ddb tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:55.784840 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-5cb65925-7844-4be8-b256-03078dad7ddb tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:55.785609 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-5cb65925-7844-4be8-b256-03078dad7ddb tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:55.786043 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-5cb65925-7844-4be8-b256-03078dad7ddb tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:55.833000 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-5cb65925-7844-4be8-b256-03078dad7ddb tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:55.833446 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-5cb65925-7844-4be8-b256-03078dad7ddb tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:55.833898 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.objects.instance [None req-5cb65925-7844-4be8-b256-03078dad7ddb tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lazy-loading 'fault' on Instance uuid 97545521-e12e-4dba-b601-3ba8b4c01e17 {{(pid=117562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 23:06:55.878246 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-5cb65925-7844-4be8-b256-03078dad7ddb tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e40b7f3da047fcbea943e7f1206bcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee581f47a5419098d02102081f617d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:06:55.886285 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-5cb65925-7844-4be8-b256-03078dad7ddb tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] 10.222.0.17 "GET /compute/v2.1/servers/97545521-e12e-4dba-b601-3ba8b4c01e17" status: 200 len: 1304 microversion: 2.1 time: 0.112978 Jun 16 23:06:55.891292 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 434/861] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:06:55 2022] GET /compute/v2.1/servers/97545521-e12e-4dba-b601-3ba8b4c01e17 => generated 1304 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 23:06:56.225050 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-e917324d-4c19-4630-a13e-b696b6f2b23a tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:06:56.225785 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-e917324d-4c19-4630-a13e-b696b6f2b23a tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:06:56.233062 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-e917324d-4c19-4630-a13e-b696b6f2b23a tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:56.233509 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-e917324d-4c19-4630-a13e-b696b6f2b23a tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:56.234344 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-e917324d-4c19-4630-a13e-b696b6f2b23a tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:56.234756 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-e917324d-4c19-4630-a13e-b696b6f2b23a tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:56.376507 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-e917324d-4c19-4630-a13e-b696b6f2b23a tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:06:56.384555 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-e917324d-4c19-4630-a13e-b696b6f2b23a tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:06:56.386032 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-e917324d-4c19-4630-a13e-b696b6f2b23a tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:06:56.387800 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-e917324d-4c19-4630-a13e-b696b6f2b23a tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "GET /compute/v2.1/servers/88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda" status: 200 len: 1731 microversion: 2.20 time: 0.166055 Jun 16 23:06:56.388549 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 435/862] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 23:06:56 2022] GET /compute/v2.1/servers/88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda => generated 1731 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 23:06:56.904857 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-bf07e166-cd88-4fb9-a624-565637979433 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:06:56.905437 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-bf07e166-cd88-4fb9-a624-565637979433 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] [instance: 97545521-e12e-4dba-b601-3ba8b4c01e17] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:06:56.911870 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-bf07e166-cd88-4fb9-a624-565637979433 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:56.912377 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-bf07e166-cd88-4fb9-a624-565637979433 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:56.913128 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-bf07e166-cd88-4fb9-a624-565637979433 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:56.913573 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-bf07e166-cd88-4fb9-a624-565637979433 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:56.944624 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-bf07e166-cd88-4fb9-a624-565637979433 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:56.945078 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-bf07e166-cd88-4fb9-a624-565637979433 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:56.945529 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.objects.instance [None req-bf07e166-cd88-4fb9-a624-565637979433 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lazy-loading 'fault' on Instance uuid 97545521-e12e-4dba-b601-3ba8b4c01e17 {{(pid=117562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 23:06:56.988291 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-bf07e166-cd88-4fb9-a624-565637979433 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e40b7f3da047fcbea943e7f1206bcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee581f47a5419098d02102081f617d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:06:56.996290 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-bf07e166-cd88-4fb9-a624-565637979433 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] 10.222.0.17 "GET /compute/v2.1/servers/97545521-e12e-4dba-b601-3ba8b4c01e17" status: 200 len: 1304 microversion: 2.1 time: 0.096107 Jun 16 23:06:56.997070 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 436/863] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:06:56 2022] GET /compute/v2.1/servers/97545521-e12e-4dba-b601-3ba8b4c01e17 => generated 1304 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 23:06:57.406165 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-b1e4e69f-351c-4147-a28f-ac3508bbb7e0 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:06:57.406906 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-b1e4e69f-351c-4147-a28f-ac3508bbb7e0 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:06:57.413298 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-b1e4e69f-351c-4147-a28f-ac3508bbb7e0 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:57.413749 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-b1e4e69f-351c-4147-a28f-ac3508bbb7e0 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:57.414521 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-b1e4e69f-351c-4147-a28f-ac3508bbb7e0 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:57.415057 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-b1e4e69f-351c-4147-a28f-ac3508bbb7e0 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:57.546256 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-b1e4e69f-351c-4147-a28f-ac3508bbb7e0 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:06:57.554382 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-b1e4e69f-351c-4147-a28f-ac3508bbb7e0 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:06:57.556017 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-b1e4e69f-351c-4147-a28f-ac3508bbb7e0 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:06:57.557163 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-b1e4e69f-351c-4147-a28f-ac3508bbb7e0 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "GET /compute/v2.1/servers/88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda" status: 200 len: 1731 microversion: 2.20 time: 0.154934 Jun 16 23:06:57.557722 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 437/864] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 23:06:57 2022] GET /compute/v2.1/servers/88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda => generated 1731 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 23:06:58.012147 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-2f34bd30-8aa0-490c-a2de-82a6cc7758d8 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:06:58.012759 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-2f34bd30-8aa0-490c-a2de-82a6cc7758d8 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] [instance: 97545521-e12e-4dba-b601-3ba8b4c01e17] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:06:58.019051 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-2f34bd30-8aa0-490c-a2de-82a6cc7758d8 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:58.019509 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-2f34bd30-8aa0-490c-a2de-82a6cc7758d8 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:58.020289 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-2f34bd30-8aa0-490c-a2de-82a6cc7758d8 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:58.020736 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-2f34bd30-8aa0-490c-a2de-82a6cc7758d8 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:58.051635 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-2f34bd30-8aa0-490c-a2de-82a6cc7758d8 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:58.052091 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-2f34bd30-8aa0-490c-a2de-82a6cc7758d8 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:58.052542 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.objects.instance [None req-2f34bd30-8aa0-490c-a2de-82a6cc7758d8 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lazy-loading 'fault' on Instance uuid 97545521-e12e-4dba-b601-3ba8b4c01e17 {{(pid=117562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 23:06:58.101251 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-2f34bd30-8aa0-490c-a2de-82a6cc7758d8 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e40b7f3da047fcbea943e7f1206bcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee581f47a5419098d02102081f617d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:06:58.109600 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-2f34bd30-8aa0-490c-a2de-82a6cc7758d8 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] 10.222.0.17 "GET /compute/v2.1/servers/97545521-e12e-4dba-b601-3ba8b4c01e17" status: 200 len: 1304 microversion: 2.1 time: 0.101173 Jun 16 23:06:58.110177 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 438/865] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:06:58 2022] GET /compute/v2.1/servers/97545521-e12e-4dba-b601-3ba8b4c01e17 => generated 1304 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 23:06:58.577007 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-cdd784dc-c16c-43d5-9f9c-726b4887e542 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:06:58.578786 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-cdd784dc-c16c-43d5-9f9c-726b4887e542 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:06:58.586361 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-cdd784dc-c16c-43d5-9f9c-726b4887e542 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:58.586840 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-cdd784dc-c16c-43d5-9f9c-726b4887e542 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:58.587614 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-cdd784dc-c16c-43d5-9f9c-726b4887e542 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:58.588049 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-cdd784dc-c16c-43d5-9f9c-726b4887e542 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:58.728803 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-cdd784dc-c16c-43d5-9f9c-726b4887e542 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:06:58.737094 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-cdd784dc-c16c-43d5-9f9c-726b4887e542 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:06:58.738636 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-cdd784dc-c16c-43d5-9f9c-726b4887e542 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:06:58.739816 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-cdd784dc-c16c-43d5-9f9c-726b4887e542 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "GET /compute/v2.1/servers/88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda" status: 200 len: 1731 microversion: 2.20 time: 0.167410 Jun 16 23:06:58.740370 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 439/866] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 23:06:58 2022] GET /compute/v2.1/servers/88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda => generated 1731 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 23:06:59.126408 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-18bcda16-9b17-4040-b000-7fcf95fc6051 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:06:59.127073 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-18bcda16-9b17-4040-b000-7fcf95fc6051 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] [instance: 97545521-e12e-4dba-b601-3ba8b4c01e17] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:06:59.133049 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-18bcda16-9b17-4040-b000-7fcf95fc6051 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:59.133495 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-18bcda16-9b17-4040-b000-7fcf95fc6051 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:59.134264 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-18bcda16-9b17-4040-b000-7fcf95fc6051 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:59.134704 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-18bcda16-9b17-4040-b000-7fcf95fc6051 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:59.165515 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-18bcda16-9b17-4040-b000-7fcf95fc6051 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:59.165956 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-18bcda16-9b17-4040-b000-7fcf95fc6051 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:59.166395 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.objects.instance [None req-18bcda16-9b17-4040-b000-7fcf95fc6051 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lazy-loading 'fault' on Instance uuid 97545521-e12e-4dba-b601-3ba8b4c01e17 {{(pid=117562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 23:06:59.207139 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-18bcda16-9b17-4040-b000-7fcf95fc6051 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e40b7f3da047fcbea943e7f1206bcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee581f47a5419098d02102081f617d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:06:59.215581 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-18bcda16-9b17-4040-b000-7fcf95fc6051 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] 10.222.0.17 "GET /compute/v2.1/servers/97545521-e12e-4dba-b601-3ba8b4c01e17" status: 200 len: 1304 microversion: 2.1 time: 0.092626 Jun 16 23:06:59.216136 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 440/867] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:06:59 2022] GET /compute/v2.1/servers/97545521-e12e-4dba-b601-3ba8b4c01e17 => generated 1304 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 23:06:59.757782 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-83813fd0-efe0-433f-8ecc-5d4f69b02a22 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:06:59.758398 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-83813fd0-efe0-433f-8ecc-5d4f69b02a22 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:06:59.765334 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-83813fd0-efe0-433f-8ecc-5d4f69b02a22 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:59.765778 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-83813fd0-efe0-433f-8ecc-5d4f69b02a22 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:59.766540 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-83813fd0-efe0-433f-8ecc-5d4f69b02a22 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:06:59.766996 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-83813fd0-efe0-433f-8ecc-5d4f69b02a22 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:06:59.895052 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-83813fd0-efe0-433f-8ecc-5d4f69b02a22 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:06:59.902891 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-83813fd0-efe0-433f-8ecc-5d4f69b02a22 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:06:59.904372 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-83813fd0-efe0-433f-8ecc-5d4f69b02a22 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:06:59.905506 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-83813fd0-efe0-433f-8ecc-5d4f69b02a22 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "GET /compute/v2.1/servers/88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda" status: 200 len: 1731 microversion: 2.20 time: 0.151725 Jun 16 23:06:59.906051 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 441/868] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 23:06:59 2022] GET /compute/v2.1/servers/88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda => generated 1731 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 23:07:00.232269 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-bbd991e6-1ef6-40d1-b242-d57b0f7645b7 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:07:00.232797 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-bbd991e6-1ef6-40d1-b242-d57b0f7645b7 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] [instance: 97545521-e12e-4dba-b601-3ba8b4c01e17] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:07:00.238895 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-bbd991e6-1ef6-40d1-b242-d57b0f7645b7 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:07:00.239347 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-bbd991e6-1ef6-40d1-b242-d57b0f7645b7 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:07:00.240116 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-bbd991e6-1ef6-40d1-b242-d57b0f7645b7 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:07:00.240579 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-bbd991e6-1ef6-40d1-b242-d57b0f7645b7 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:07:00.256066 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.wsgi [None req-bbd991e6-1ef6-40d1-b242-d57b0f7645b7 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] HTTP exception thrown: Instance 97545521-e12e-4dba-b601-3ba8b4c01e17 could not be found. Jun 16 23:07:00.257683 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-bbd991e6-1ef6-40d1-b242-d57b0f7645b7 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Request method failure captured: Jun 16 23:07:00.257683 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: request: GET /compute/v2.1/servers/97545521-e12e-4dba-b601-3ba8b4c01e17 HTTP/1.1 Jun 16 23:07:00.257683 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Accept: application/json Jun 16 23:07:00.257683 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Accept-Encoding: identity Jun 16 23:07:00.257683 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Connection: close Jun 16 23:07:00.257683 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Content-Length: 0 Jun 16 23:07:00.257683 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Content-Type: application/json Jun 16 23:07:00.257683 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Host: 10.222.0.17 Jun 16 23:07:00.257683 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Openstack-System-Scope: None Jun 16 23:07:00.257683 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: User-Agent: python-urllib3/1.26.9 Jun 16 23:07:00.257683 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Auth-Token: gAAAAABiq7d2dvJIRUCd2Q9JNTXpOkwWBGhmncBh-nTTKV2P1VF6dkPSKTtgBh9_RAyZJ1xRMXK9ZQp7XogvI4_A5DvS4QqgWpwqftVLM_eG-SILS6qmyBcea6UbfCbdPfaRQGZCV30_B3U89jm6RnfAuBvv9oQhAfq9xDeA04w7kRsb0Z1ScZs Jun 16 23:07:00.257683 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Domain-Id: None Jun 16 23:07:00.257683 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Domain-Name: None Jun 16 23:07:00.257683 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Identity-Status: Confirmed Jun 16 23:07:00.257683 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Is-Admin-Project: True Jun 16 23:07:00.257683 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Project-Domain-Id: default Jun 16 23:07:00.257683 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Project-Domain-Name: Default Jun 16 23:07:00.257683 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Project-Id: 91ee581f47a5419098d02102081f617d Jun 16 23:07:00.257683 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Project-Name: tempest-VolumesActionsTest-716400687 Jun 16 23:07:00.257683 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Role: member,reader Jun 16 23:07:00.257683 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Roles: member,reader Jun 16 23:07:00.259270 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/91ee581f47a5419098d02102081f617d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_91ee581f47a5419098d02102081f617d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/91ee581f47a5419098d02102081f617d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/91ee581f47a5419098d02102081f617d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Jun 16 23:07:00.259270 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Tenant: tempest-VolumesActionsTest-716400687 Jun 16 23:07:00.259270 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Tenant-Id: 91ee581f47a5419098d02102081f617d Jun 16 23:07:00.259270 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Tenant-Name: tempest-VolumesActionsTest-716400687 Jun 16 23:07:00.259270 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-User: tempest-VolumesActionsTest-716400687-project Jun 16 23:07:00.259270 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-User-Domain-Id: default Jun 16 23:07:00.259270 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-User-Domain-Name: Default Jun 16 23:07:00.259270 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-User-Id: 61e40b7f3da047fcbea943e7f1206bcb Jun 16 23:07:00.259270 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-User-Name: tempest-VolumesActionsTest-716400687-project Jun 16 23:07:00.259270 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: method: > Jun 16 23:07:00.259270 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: exception: Instance 97545521-e12e-4dba-b601-3ba8b4c01e17 could not be found. Jun 16 23:07:00.259270 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: action_args: {'id': '97545521-e12e-4dba-b601-3ba8b4c01e17'} Jun 16 23:07:00.260066 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 23:07:00.260066 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 23:07:00.260066 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 23:07:00.260066 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 23:07:00.260066 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 23:07:00.260066 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 23:07:00.260066 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 23:07:00.260066 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 23:07:00.260066 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 23:07:00.260066 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 23:07:00.260066 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97545521-e12e-4dba-b601-3ba8b4c01e17 could not be found. Jun 16 23:07:00.260066 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Jun 16 23:07:00.260066 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 23:07:00.260066 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Jun 16 23:07:00.260066 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 23:07:00.260066 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 23:07:00.260066 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 23:07:00.260066 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 23:07:00.260066 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 23:07:00.260066 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 23:07:00.261337 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 23:07:00.261337 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 23:07:00.261337 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 23:07:00.261337 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 23:07:00.261337 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 23:07:00.261337 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 23:07:00.261337 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 23:07:00.261337 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97545521-e12e-4dba-b601-3ba8b4c01e17 could not be found. Jun 16 23:07:00.261337 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Jun 16 23:07:00.261337 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 23:07:00.261337 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Jun 16 23:07:00.261337 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 23:07:00.261337 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 23:07:00.261337 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 23:07:00.261337 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 23:07:00.261337 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 23:07:00.261337 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97545521-e12e-4dba-b601-3ba8b4c01e17 could not be found. Jun 16 23:07:00.261337 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Jun 16 23:07:00.262456 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-bbd991e6-1ef6-40d1-b242-d57b0f7645b7 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Returning 404 to user: Instance 97545521-e12e-4dba-b601-3ba8b4c01e17 could not be found. {{(pid=117562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 23:07:00.262456 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-bbd991e6-1ef6-40d1-b242-d57b0f7645b7 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] 10.222.0.17 "GET /compute/v2.1/servers/97545521-e12e-4dba-b601-3ba8b4c01e17" status: 404 len: 111 microversion: 2.1 time: 0.031265 Jun 16 23:07:00.262456 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 442/869] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:07:00 2022] GET /compute/v2.1/servers/97545521-e12e-4dba-b601-3ba8b4c01e17 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 23:07:00.307593 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-408315b8-b20c-428d-b811-e5f5945abc00 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-533732871", "imageRef": "2b486731-e5ea-4159-b6b1-ed0083e00543", "flavorRef": "452", "networks": [{"uuid": "5e7c7db6-6141-4dba-9168-34f346c470b1"}]}} {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 23:07:00.511626 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.network.neutron [None req-408315b8-b20c-428d-b811-e5f5945abc00 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] validate_networks() for [('5e7c7db6-6141-4dba-9168-34f346c470b1', None, None, None, None, None)] {{(pid=117562) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 23:07:00.551455 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-6914fb49-d790-4b5f-afcf-ef4019b08ce8 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] 10.222.0.17 "POST /compute/v2.1/servers/b7619c39-737f-440b-b676-8e920380d6c6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 6.226136 Jun 16 23:07:00.552072 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 428/870] 10.222.0.17 () {60 vars in 1322 bytes} [Thu Jun 16 23:06:54 2022] POST /compute/v2.1/servers/b7619c39-737f-440b-b676-8e920380d6c6/os-volume_attachments => generated 194 bytes in 6228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 23:07:00.859930 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.virt.hardware [None req-408315b8-b20c-428d-b811-e5f5945abc00 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Flavor limits 0:0:0 {{(pid=117562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 23:07:00.860409 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.virt.hardware [None req-408315b8-b20c-428d-b811-e5f5945abc00 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Image limits 0:0:0 {{(pid=117562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 23:07:00.860847 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.virt.hardware [None req-408315b8-b20c-428d-b811-e5f5945abc00 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Flavor pref 0:0:0 {{(pid=117562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 23:07:00.861257 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.virt.hardware [None req-408315b8-b20c-428d-b811-e5f5945abc00 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Image pref 0:0:0 {{(pid=117562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 23:07:00.861669 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.virt.hardware [None req-408315b8-b20c-428d-b811-e5f5945abc00 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117562) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 23:07:00.870426 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-408315b8-b20c-428d-b811-e5f5945abc00 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:07:00.870900 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-408315b8-b20c-428d-b811-e5f5945abc00 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:07:00.871705 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-408315b8-b20c-428d-b811-e5f5945abc00 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:07:00.872201 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-408315b8-b20c-428d-b811-e5f5945abc00 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:07:00.889480 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.quota [None req-408315b8-b20c-428d-b811-e5f5945abc00 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Getting quotas for project 91ee581f47a5419098d02102081f617d. Resources: {'instances', 'cores', 'ram'} {{(pid=117562) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 23:07:00.893369 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.quota [None req-408315b8-b20c-428d-b811-e5f5945abc00 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Getting quotas for user 61e40b7f3da047fcbea943e7f1206bcb and project 91ee581f47a5419098d02102081f617d. Resources: {'instances', 'cores', 'ram'} {{(pid=117562) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 23:07:00.904474 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-408315b8-b20c-428d-b811-e5f5945abc00 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Going to run 1 instances... {{(pid=117562) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 23:07:00.906709 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-408315b8-b20c-428d-b811-e5f5945abc00 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] [instance: 906439ae-f5b3-40f5-a7ea-9d308866247a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2b486731-e5ea-4159-b6b1-ed0083e00543',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117562) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 23:07:00.924288 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-81fd72a4-1737-4438-b1d5-613c9fc58bee tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:07:00.924987 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-81fd72a4-1737-4438-b1d5-613c9fc58bee tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:07:00.931643 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-81fd72a4-1737-4438-b1d5-613c9fc58bee tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:07:00.932097 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-81fd72a4-1737-4438-b1d5-613c9fc58bee tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:07:00.932870 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-81fd72a4-1737-4438-b1d5-613c9fc58bee tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:07:00.933329 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-81fd72a4-1737-4438-b1d5-613c9fc58bee tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:07:00.953439 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-408315b8-b20c-428d-b811-e5f5945abc00 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.649516 Jun 16 23:07:00.954202 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 443/871] 10.222.0.17 () {60 vars in 1146 bytes} [Thu Jun 16 23:07:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 651 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 16 23:07:00.966082 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-0777f332-53a4-44eb-b27b-8f2e95692a5c tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:07:00.967279 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-0777f332-53a4-44eb-b27b-8f2e95692a5c tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] [instance: 906439ae-f5b3-40f5-a7ea-9d308866247a] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:07:01.038284 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-0777f332-53a4-44eb-b27b-8f2e95692a5c tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e40b7f3da047fcbea943e7f1206bcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee581f47a5419098d02102081f617d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:07:01.047755 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-0777f332-53a4-44eb-b27b-8f2e95692a5c tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] 10.222.0.17 "GET /compute/v2.1/servers/906439ae-f5b3-40f5-a7ea-9d308866247a" status: 200 len: 1213 microversion: 2.1 time: 0.087515 Jun 16 23:07:01.050634 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 444/872] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:07:00 2022] GET /compute/v2.1/servers/906439ae-f5b3-40f5-a7ea-9d308866247a => generated 1213 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 23:07:01.107607 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-81fd72a4-1737-4438-b1d5-613c9fc58bee tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:07:01.116298 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-81fd72a4-1737-4438-b1d5-613c9fc58bee tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:07:01.117806 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-81fd72a4-1737-4438-b1d5-613c9fc58bee tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:07:01.119161 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-81fd72a4-1737-4438-b1d5-613c9fc58bee tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "GET /compute/v2.1/servers/88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda" status: 200 len: 1731 microversion: 2.20 time: 0.199703 Jun 16 23:07:01.119714 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 429/873] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 23:07:00 2022] GET /compute/v2.1/servers/88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda => generated 1731 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 23:07:02.064986 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-571b1b5f-a0ac-421d-b30b-3834da57be63 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:07:02.065635 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-571b1b5f-a0ac-421d-b30b-3834da57be63 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] [instance: 906439ae-f5b3-40f5-a7ea-9d308866247a] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:07:02.076768 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-571b1b5f-a0ac-421d-b30b-3834da57be63 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:07:02.077763 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-571b1b5f-a0ac-421d-b30b-3834da57be63 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:07:02.078548 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-571b1b5f-a0ac-421d-b30b-3834da57be63 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:07:02.079035 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-571b1b5f-a0ac-421d-b30b-3834da57be63 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:07:02.137962 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-cd9fad23-90fe-45d4-aa73-61437ee03a66 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:07:02.138508 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-cd9fad23-90fe-45d4-aa73-61437ee03a66 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:07:02.145131 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-cd9fad23-90fe-45d4-aa73-61437ee03a66 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:07:02.145586 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-cd9fad23-90fe-45d4-aa73-61437ee03a66 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:07:02.146379 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-cd9fad23-90fe-45d4-aa73-61437ee03a66 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:07:02.146850 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-cd9fad23-90fe-45d4-aa73-61437ee03a66 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:07:02.209385 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-571b1b5f-a0ac-421d-b30b-3834da57be63 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e40b7f3da047fcbea943e7f1206bcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee581f47a5419098d02102081f617d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:07:02.218159 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-571b1b5f-a0ac-421d-b30b-3834da57be63 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] 10.222.0.17 "GET /compute/v2.1/servers/906439ae-f5b3-40f5-a7ea-9d308866247a" status: 200 len: 1271 microversion: 2.1 time: 0.156984 Jun 16 23:07:02.218739 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 445/874] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:07:02 2022] GET /compute/v2.1/servers/906439ae-f5b3-40f5-a7ea-9d308866247a => generated 1271 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:07:02.387656 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-cd9fad23-90fe-45d4-aa73-61437ee03a66 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:07:02.395501 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-cd9fad23-90fe-45d4-aa73-61437ee03a66 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:07:02.396957 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-cd9fad23-90fe-45d4-aa73-61437ee03a66 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:07:02.398111 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-cd9fad23-90fe-45d4-aa73-61437ee03a66 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "GET /compute/v2.1/servers/88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda" status: 200 len: 1731 microversion: 2.20 time: 0.264356 Jun 16 23:07:02.398695 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 430/875] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 23:07:02 2022] GET /compute/v2.1/servers/88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda => generated 1731 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 23:07:03.235226 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-9bf95b76-5d8b-4bcc-97ef-a56c27f1a392 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:07:03.236731 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-9bf95b76-5d8b-4bcc-97ef-a56c27f1a392 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] [instance: 906439ae-f5b3-40f5-a7ea-9d308866247a] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:07:03.243491 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-9bf95b76-5d8b-4bcc-97ef-a56c27f1a392 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:07:03.244018 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-9bf95b76-5d8b-4bcc-97ef-a56c27f1a392 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:07:03.244942 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-9bf95b76-5d8b-4bcc-97ef-a56c27f1a392 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:07:03.245446 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-9bf95b76-5d8b-4bcc-97ef-a56c27f1a392 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:07:03.263784 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG dbcounter [-] [117562] Writing DB stats nova_cell1:SELECT=100 {{(pid=117562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 23:07:03.415862 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-bcfdbfe9-10cd-4cf5-a253-2802f0b7da31 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:07:03.416469 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-bcfdbfe9-10cd-4cf5-a253-2802f0b7da31 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:07:03.423016 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-bcfdbfe9-10cd-4cf5-a253-2802f0b7da31 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:07:03.423468 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-bcfdbfe9-10cd-4cf5-a253-2802f0b7da31 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:07:03.424236 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-bcfdbfe9-10cd-4cf5-a253-2802f0b7da31 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:07:03.424677 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-bcfdbfe9-10cd-4cf5-a253-2802f0b7da31 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:07:03.446514 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-9bf95b76-5d8b-4bcc-97ef-a56c27f1a392 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e40b7f3da047fcbea943e7f1206bcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee581f47a5419098d02102081f617d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:07:03.462767 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-9bf95b76-5d8b-4bcc-97ef-a56c27f1a392 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] 10.222.0.17 "GET /compute/v2.1/servers/906439ae-f5b3-40f5-a7ea-9d308866247a" status: 200 len: 1313 microversion: 2.1 time: 0.231375 Jun 16 23:07:03.463337 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 446/876] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:07:03 2022] GET /compute/v2.1/servers/906439ae-f5b3-40f5-a7ea-9d308866247a => generated 1313 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:07:03.639923 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-bcfdbfe9-10cd-4cf5-a253-2802f0b7da31 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:07:03.649153 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-bcfdbfe9-10cd-4cf5-a253-2802f0b7da31 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:07:03.650961 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-bcfdbfe9-10cd-4cf5-a253-2802f0b7da31 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:07:03.653021 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-bcfdbfe9-10cd-4cf5-a253-2802f0b7da31 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "GET /compute/v2.1/servers/88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda" status: 200 len: 1731 microversion: 2.20 time: 0.240905 Jun 16 23:07:03.653822 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 431/877] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 23:07:03 2022] GET /compute/v2.1/servers/88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda => generated 1731 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 23:07:03.658166 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [req-3e95fc36-0b5f-4e1b-a657-6d952f7fd391 req-6084d1aa-437c-4518-ac10-8b85a356ef16 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "906439ae-f5b3-40f5-a7ea-9d308866247a", "tag": "8c72756a-f229-4045-b37e-534047055292"}]} {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 23:07:03.673060 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [req-3e95fc36-0b5f-4e1b-a657-6d952f7fd391 req-6084d1aa-437c-4518-ac10-8b85a356ef16 service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:07:03.673600 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [req-3e95fc36-0b5f-4e1b-a657-6d952f7fd391 req-6084d1aa-437c-4518-ac10-8b85a356ef16 service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:07:03.685057 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.compute.server_external_events [req-3e95fc36-0b5f-4e1b-a657-6d952f7fd391 req-6084d1aa-437c-4518-ac10-8b85a356ef16 service nova] Creating event network-changed:8c72756a-f229-4045-b37e-534047055292 for instance 906439ae-f5b3-40f5-a7ea-9d308866247a on hv-cinder-84623 Jun 16 23:07:03.689794 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [req-3e95fc36-0b5f-4e1b-a657-6d952f7fd391 req-6084d1aa-437c-4518-ac10-8b85a356ef16 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035406 Jun 16 23:07:03.690581 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 447/878] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 23:07:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 23:07:03.873533 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [req-bda04903-36dc-43b5-9483-ad6666eaf019 req-e398a00a-b4b6-4d3a-8b2b-dcf409fced18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda", "name": "network-vif-plugged", "status": "completed", "tag": "4b3b90f0-95df-4c59-9186-169416370496"}]} {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 23:07:03.881977 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-bda04903-36dc-43b5-9483-ad6666eaf019 req-e398a00a-b4b6-4d3a-8b2b-dcf409fced18 service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:07:03.882423 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-bda04903-36dc-43b5-9483-ad6666eaf019 req-e398a00a-b4b6-4d3a-8b2b-dcf409fced18 service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:07:03.894353 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.compute.server_external_events [req-bda04903-36dc-43b5-9483-ad6666eaf019 req-e398a00a-b4b6-4d3a-8b2b-dcf409fced18 service nova] Creating event network-vif-plugged:4b3b90f0-95df-4c59-9186-169416370496 for instance 88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda on hv-cinder-84623 Jun 16 23:07:03.899219 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [req-bda04903-36dc-43b5-9483-ad6666eaf019 req-e398a00a-b4b6-4d3a-8b2b-dcf409fced18 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029789 Jun 16 23:07:03.899816 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 432/879] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 23:07:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 23:07:04.481783 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-6ce3fc01-bbea-4207-acf9-d9243186ef56 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:07:04.482464 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-6ce3fc01-bbea-4207-acf9-d9243186ef56 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] [instance: 906439ae-f5b3-40f5-a7ea-9d308866247a] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:07:04.488592 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-6ce3fc01-bbea-4207-acf9-d9243186ef56 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:07:04.489033 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-6ce3fc01-bbea-4207-acf9-d9243186ef56 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:07:04.489790 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-6ce3fc01-bbea-4207-acf9-d9243186ef56 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:07:04.490224 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-6ce3fc01-bbea-4207-acf9-d9243186ef56 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:07:04.620224 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-6ce3fc01-bbea-4207-acf9-d9243186ef56 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e40b7f3da047fcbea943e7f1206bcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee581f47a5419098d02102081f617d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:07:04.627544 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-6ce3fc01-bbea-4207-acf9-d9243186ef56 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] 10.222.0.17 "GET /compute/v2.1/servers/906439ae-f5b3-40f5-a7ea-9d308866247a" status: 200 len: 1313 microversion: 2.1 time: 0.151031 Jun 16 23:07:04.628100 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 448/880] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:07:04 2022] GET /compute/v2.1/servers/906439ae-f5b3-40f5-a7ea-9d308866247a => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:07:04.671323 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-e4833cd5-0bcd-4b53-96c4-49e03dc404fd tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:07:04.672052 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-e4833cd5-0bcd-4b53-96c4-49e03dc404fd tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:07:04.673966 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG dbcounter [-] [117563] Writing DB stats nova_api:INSERT=1,nova_api:SELECT=68,nova_api:UPDATE=1 {{(pid=117563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 23:07:04.679454 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-e4833cd5-0bcd-4b53-96c4-49e03dc404fd tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:07:04.679911 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-e4833cd5-0bcd-4b53-96c4-49e03dc404fd tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:07:04.680683 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-e4833cd5-0bcd-4b53-96c4-49e03dc404fd tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:07:04.681132 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-e4833cd5-0bcd-4b53-96c4-49e03dc404fd tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:07:04.809293 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-e4833cd5-0bcd-4b53-96c4-49e03dc404fd tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:07:04.824194 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-e4833cd5-0bcd-4b53-96c4-49e03dc404fd tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:07:04.825755 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-e4833cd5-0bcd-4b53-96c4-49e03dc404fd tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:07:04.827308 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-e4833cd5-0bcd-4b53-96c4-49e03dc404fd tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "GET /compute/v2.1/servers/88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda" status: 200 len: 1731 microversion: 2.20 time: 0.161038 Jun 16 23:07:04.828032 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 433/881] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 23:07:04 2022] GET /compute/v2.1/servers/88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda => generated 1731 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 23:07:05.644008 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-af920c0f-30fb-4921-876b-7d4917a012a9 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:07:05.644613 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-af920c0f-30fb-4921-876b-7d4917a012a9 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] [instance: 906439ae-f5b3-40f5-a7ea-9d308866247a] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:07:05.651060 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-af920c0f-30fb-4921-876b-7d4917a012a9 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:07:05.651528 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-af920c0f-30fb-4921-876b-7d4917a012a9 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:07:05.652290 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-af920c0f-30fb-4921-876b-7d4917a012a9 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:07:05.652724 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-af920c0f-30fb-4921-876b-7d4917a012a9 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:07:05.778342 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-af920c0f-30fb-4921-876b-7d4917a012a9 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e40b7f3da047fcbea943e7f1206bcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee581f47a5419098d02102081f617d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:07:05.785815 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-af920c0f-30fb-4921-876b-7d4917a012a9 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] 10.222.0.17 "GET /compute/v2.1/servers/906439ae-f5b3-40f5-a7ea-9d308866247a" status: 200 len: 1313 microversion: 2.1 time: 0.145591 Jun 16 23:07:05.786391 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 449/882] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:07:05 2022] GET /compute/v2.1/servers/906439ae-f5b3-40f5-a7ea-9d308866247a => generated 1313 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:07:05.845783 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-751c7988-ceb1-401d-b69b-794a6c8d9656 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:07:05.847232 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-751c7988-ceb1-401d-b69b-794a6c8d9656 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:07:05.853900 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-751c7988-ceb1-401d-b69b-794a6c8d9656 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:07:05.854512 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-751c7988-ceb1-401d-b69b-794a6c8d9656 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:07:05.856142 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-751c7988-ceb1-401d-b69b-794a6c8d9656 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:07:05.856617 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-751c7988-ceb1-401d-b69b-794a6c8d9656 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:07:05.992452 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-751c7988-ceb1-401d-b69b-794a6c8d9656 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:07:06.002289 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-751c7988-ceb1-401d-b69b-794a6c8d9656 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:07:06.003835 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-751c7988-ceb1-401d-b69b-794a6c8d9656 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:07:06.005000 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-751c7988-ceb1-401d-b69b-794a6c8d9656 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "GET /compute/v2.1/servers/88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda" status: 200 len: 1731 microversion: 2.20 time: 0.163138 Jun 16 23:07:06.005564 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 434/883] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 23:07:05 2022] GET /compute/v2.1/servers/88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda => generated 1731 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 23:07:06.802884 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-f3f03089-3c2d-484f-b6c9-70e5a50bf378 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:07:06.803490 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-f3f03089-3c2d-484f-b6c9-70e5a50bf378 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] [instance: 906439ae-f5b3-40f5-a7ea-9d308866247a] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:07:06.812101 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-f3f03089-3c2d-484f-b6c9-70e5a50bf378 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:07:06.812772 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-f3f03089-3c2d-484f-b6c9-70e5a50bf378 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:07:06.814127 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-f3f03089-3c2d-484f-b6c9-70e5a50bf378 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:07:06.814980 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-f3f03089-3c2d-484f-b6c9-70e5a50bf378 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:07:06.944921 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-f3f03089-3c2d-484f-b6c9-70e5a50bf378 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e40b7f3da047fcbea943e7f1206bcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee581f47a5419098d02102081f617d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:07:06.952570 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-f3f03089-3c2d-484f-b6c9-70e5a50bf378 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] 10.222.0.17 "GET /compute/v2.1/servers/906439ae-f5b3-40f5-a7ea-9d308866247a" status: 200 len: 1313 microversion: 2.1 time: 0.153567 Jun 16 23:07:06.953122 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 450/884] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:07:06 2022] GET /compute/v2.1/servers/906439ae-f5b3-40f5-a7ea-9d308866247a => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:07:07.022759 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-15999fc3-17e3-4be0-b3f5-0c9e3957eca6 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:07:07.023324 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-15999fc3-17e3-4be0-b3f5-0c9e3957eca6 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:07:07.030174 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-15999fc3-17e3-4be0-b3f5-0c9e3957eca6 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:07:07.030644 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-15999fc3-17e3-4be0-b3f5-0c9e3957eca6 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:07:07.031406 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-15999fc3-17e3-4be0-b3f5-0c9e3957eca6 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:07:07.031840 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-15999fc3-17e3-4be0-b3f5-0c9e3957eca6 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:07:07.165750 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-15999fc3-17e3-4be0-b3f5-0c9e3957eca6 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:07:07.176378 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-15999fc3-17e3-4be0-b3f5-0c9e3957eca6 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:07:07.177919 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-15999fc3-17e3-4be0-b3f5-0c9e3957eca6 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:07:07.179189 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-15999fc3-17e3-4be0-b3f5-0c9e3957eca6 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "GET /compute/v2.1/servers/88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda" status: 200 len: 1731 microversion: 2.20 time: 0.160446 Jun 16 23:07:07.179905 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 435/885] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 23:07:07 2022] GET /compute/v2.1/servers/88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda => generated 1731 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 23:07:07.969330 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-58fad729-916d-4370-a43d-88d95acf7f5b tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:07:07.970048 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-58fad729-916d-4370-a43d-88d95acf7f5b tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] [instance: 906439ae-f5b3-40f5-a7ea-9d308866247a] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:07:07.982751 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-58fad729-916d-4370-a43d-88d95acf7f5b tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:07:07.983286 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-58fad729-916d-4370-a43d-88d95acf7f5b tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:07:07.984331 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-58fad729-916d-4370-a43d-88d95acf7f5b tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:07:07.985049 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-58fad729-916d-4370-a43d-88d95acf7f5b tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:07:08.064697 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-4f4b02e2-2707-41ed-86ed-291c6f3253c4 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:07:08.065630 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-4f4b02e2-2707-41ed-86ed-291c6f3253c4 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] [instance: b7619c39-737f-440b-b676-8e920380d6c6] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:07:08.072227 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-4f4b02e2-2707-41ed-86ed-291c6f3253c4 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:07:08.072669 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-4f4b02e2-2707-41ed-86ed-291c6f3253c4 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:07:08.073574 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-4f4b02e2-2707-41ed-86ed-291c6f3253c4 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:07:08.074380 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-4f4b02e2-2707-41ed-86ed-291c6f3253c4 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:07:08.113259 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-4f4b02e2-2707-41ed-86ed-291c6f3253c4 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] 10.222.0.17 "GET /compute/v2.1/servers/b7619c39-737f-440b-b676-8e920380d6c6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052474 Jun 16 23:07:08.113848 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 436/886] 10.222.0.17 () {58 vars in 1301 bytes} [Thu Jun 16 23:07:08 2022] GET /compute/v2.1/servers/b7619c39-737f-440b-b676-8e920380d6c6/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 23:07:08.120995 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-58fad729-916d-4370-a43d-88d95acf7f5b tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e40b7f3da047fcbea943e7f1206bcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee581f47a5419098d02102081f617d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:07:08.123609 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-35ac32bc-f50a-4541-9ec0-3e33b8fa4693 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:07:08.124102 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-35ac32bc-f50a-4541-9ec0-3e33b8fa4693 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] [instance: b7619c39-737f-440b-b676-8e920380d6c6] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:07:08.128775 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-58fad729-916d-4370-a43d-88d95acf7f5b tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] 10.222.0.17 "GET /compute/v2.1/servers/906439ae-f5b3-40f5-a7ea-9d308866247a" status: 200 len: 1313 microversion: 2.1 time: 0.163811 Jun 16 23:07:08.129452 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 451/887] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:07:07 2022] GET /compute/v2.1/servers/906439ae-f5b3-40f5-a7ea-9d308866247a => generated 1313 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:07:08.130902 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-35ac32bc-f50a-4541-9ec0-3e33b8fa4693 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:07:08.131433 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-35ac32bc-f50a-4541-9ec0-3e33b8fa4693 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:07:08.132847 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-35ac32bc-f50a-4541-9ec0-3e33b8fa4693 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:07:08.133445 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-35ac32bc-f50a-4541-9ec0-3e33b8fa4693 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:07:08.165472 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-35ac32bc-f50a-4541-9ec0-3e33b8fa4693 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] 10.222.0.17 "GET /compute/v2.1/servers/b7619c39-737f-440b-b676-8e920380d6c6/os-volume_attachments/456f85b5-0d99-4809-a886-316018a40337" status: 200 len: 194 microversion: 2.1 time: 0.045354 Jun 16 23:07:08.166075 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 437/888] 10.222.0.17 () {58 vars in 1412 bytes} [Thu Jun 16 23:07:08 2022] GET /compute/v2.1/servers/b7619c39-737f-440b-b676-8e920380d6c6/os-volume_attachments/456f85b5-0d99-4809-a886-316018a40337 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 23:07:08.200830 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-a3125111-d27a-4153-be5f-5a5c3d85195f tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:07:08.201423 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-a3125111-d27a-4153-be5f-5a5c3d85195f tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:07:08.212804 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG dbcounter [-] [117562] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=117562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 23:07:08.215114 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-a3125111-d27a-4153-be5f-5a5c3d85195f tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:07:08.215610 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-a3125111-d27a-4153-be5f-5a5c3d85195f tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:07:08.216398 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-a3125111-d27a-4153-be5f-5a5c3d85195f tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:07:08.216897 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-a3125111-d27a-4153-be5f-5a5c3d85195f tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:07:08.385465 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-a3125111-d27a-4153-be5f-5a5c3d85195f tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:07:08.397846 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-a3125111-d27a-4153-be5f-5a5c3d85195f tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:07:08.399609 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-a3125111-d27a-4153-be5f-5a5c3d85195f tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:07:08.401686 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-a3125111-d27a-4153-be5f-5a5c3d85195f tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "GET /compute/v2.1/servers/88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda" status: 200 len: 1718 microversion: 2.20 time: 0.207228 Jun 16 23:07:08.402252 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 452/889] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 23:07:08 2022] GET /compute/v2.1/servers/88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda => generated 1718 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 23:07:09.145906 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-1ae51c5c-65da-4699-92c3-9c7f05f5f8f5 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:07:09.146516 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-1ae51c5c-65da-4699-92c3-9c7f05f5f8f5 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] [instance: 906439ae-f5b3-40f5-a7ea-9d308866247a] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:07:09.153012 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-1ae51c5c-65da-4699-92c3-9c7f05f5f8f5 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:07:09.153458 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-1ae51c5c-65da-4699-92c3-9c7f05f5f8f5 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:07:09.154221 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-1ae51c5c-65da-4699-92c3-9c7f05f5f8f5 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:07:09.154694 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-1ae51c5c-65da-4699-92c3-9c7f05f5f8f5 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:07:09.284807 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-1ae51c5c-65da-4699-92c3-9c7f05f5f8f5 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e40b7f3da047fcbea943e7f1206bcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee581f47a5419098d02102081f617d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:07:09.292163 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-1ae51c5c-65da-4699-92c3-9c7f05f5f8f5 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] 10.222.0.17 "GET /compute/v2.1/servers/906439ae-f5b3-40f5-a7ea-9d308866247a" status: 200 len: 1313 microversion: 2.1 time: 0.150109 Jun 16 23:07:09.292719 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 438/890] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:07:09 2022] GET /compute/v2.1/servers/906439ae-f5b3-40f5-a7ea-9d308866247a => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:07:09.542477 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-f574d191-c0e3-4300-8faa-9568fad0c225 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4dbfeb0f-9dd0-454b-b47f-83c3709b77d4"}} {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 23:07:09.544157 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-f574d191-c0e3-4300-8faa-9568fad0c225 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] [instance: b7619c39-737f-440b-b676-8e920380d6c6] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:07:09.550668 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-f574d191-c0e3-4300-8faa-9568fad0c225 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:07:09.551133 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-f574d191-c0e3-4300-8faa-9568fad0c225 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:07:09.551904 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-f574d191-c0e3-4300-8faa-9568fad0c225 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:07:09.552343 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-f574d191-c0e3-4300-8faa-9568fad0c225 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:07:09.786491 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-f574d191-c0e3-4300-8faa-9568fad0c225 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] 10.222.0.17 "POST /compute/v2.1/servers/b7619c39-737f-440b-b676-8e920380d6c6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.247427 Jun 16 23:07:09.787142 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 453/891] 10.222.0.17 () {60 vars in 1322 bytes} [Thu Jun 16 23:07:09 2022] POST /compute/v2.1/servers/b7619c39-737f-440b-b676-8e920380d6c6/os-volume_attachments => generated 194 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 23:07:09.921759 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [req-f2020a00-6344-4dc9-898d-788b840f7235 req-3b238901-03bd-4cb9-9aaf-7a0182134ad5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "906439ae-f5b3-40f5-a7ea-9d308866247a", "name": "network-vif-plugged", "status": "completed", "tag": "8c72756a-f229-4045-b37e-534047055292"}]} {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 23:07:09.933008 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-f2020a00-6344-4dc9-898d-788b840f7235 req-3b238901-03bd-4cb9-9aaf-7a0182134ad5 service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:07:09.933452 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-f2020a00-6344-4dc9-898d-788b840f7235 req-3b238901-03bd-4cb9-9aaf-7a0182134ad5 service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:07:09.944751 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.compute.server_external_events [req-f2020a00-6344-4dc9-898d-788b840f7235 req-3b238901-03bd-4cb9-9aaf-7a0182134ad5 service nova] Creating event network-vif-plugged:8c72756a-f229-4045-b37e-534047055292 for instance 906439ae-f5b3-40f5-a7ea-9d308866247a on hv-cinder-84623 Jun 16 23:07:09.951669 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [req-f2020a00-6344-4dc9-898d-788b840f7235 req-3b238901-03bd-4cb9-9aaf-7a0182134ad5 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036451 Jun 16 23:07:09.952270 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 439/892] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 23:07:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 23:07:10.310158 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-d60a0920-261d-4676-8aed-99d516d85983 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:07:10.310893 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-d60a0920-261d-4676-8aed-99d516d85983 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] [instance: 906439ae-f5b3-40f5-a7ea-9d308866247a] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:07:10.317561 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-d60a0920-261d-4676-8aed-99d516d85983 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:07:10.317994 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-d60a0920-261d-4676-8aed-99d516d85983 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:07:10.318786 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-d60a0920-261d-4676-8aed-99d516d85983 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:07:10.319220 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-d60a0920-261d-4676-8aed-99d516d85983 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:07:10.445394 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-d60a0920-261d-4676-8aed-99d516d85983 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e40b7f3da047fcbea943e7f1206bcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee581f47a5419098d02102081f617d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:07:10.453567 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-d60a0920-261d-4676-8aed-99d516d85983 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] 10.222.0.17 "GET /compute/v2.1/servers/906439ae-f5b3-40f5-a7ea-9d308866247a" status: 200 len: 1313 microversion: 2.1 time: 0.148089 Jun 16 23:07:10.454114 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 454/893] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:07:10 2022] GET /compute/v2.1/servers/906439ae-f5b3-40f5-a7ea-9d308866247a => generated 1313 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:07:11.470217 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-ae16a797-46c7-4f31-924b-781189bd4aed tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:07:11.470969 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-ae16a797-46c7-4f31-924b-781189bd4aed tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] [instance: 906439ae-f5b3-40f5-a7ea-9d308866247a] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:07:11.477664 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-ae16a797-46c7-4f31-924b-781189bd4aed tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:07:11.478113 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-ae16a797-46c7-4f31-924b-781189bd4aed tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:07:11.478930 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-ae16a797-46c7-4f31-924b-781189bd4aed tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:07:11.479367 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-ae16a797-46c7-4f31-924b-781189bd4aed tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:07:11.610097 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-ae16a797-46c7-4f31-924b-781189bd4aed tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e40b7f3da047fcbea943e7f1206bcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee581f47a5419098d02102081f617d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:07:11.617401 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-ae16a797-46c7-4f31-924b-781189bd4aed tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] 10.222.0.17 "GET /compute/v2.1/servers/906439ae-f5b3-40f5-a7ea-9d308866247a" status: 200 len: 1313 microversion: 2.1 time: 0.151373 Jun 16 23:07:11.617950 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 440/894] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:07:11 2022] GET /compute/v2.1/servers/906439ae-f5b3-40f5-a7ea-9d308866247a => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:07:12.633130 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-6e03ea64-61cf-45db-ba2b-04a220669a74 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:07:12.633740 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-6e03ea64-61cf-45db-ba2b-04a220669a74 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] [instance: 906439ae-f5b3-40f5-a7ea-9d308866247a] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:07:12.636116 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG dbcounter [-] [117562] Writing DB stats nova_cell0:SELECT=2 {{(pid=117562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 23:07:12.636795 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG dbcounter [-] [117562] Writing DB stats nova_cell0:SELECT=8 {{(pid=117562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 23:07:12.643148 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-6e03ea64-61cf-45db-ba2b-04a220669a74 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:07:12.643639 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-6e03ea64-61cf-45db-ba2b-04a220669a74 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:07:12.644417 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-6e03ea64-61cf-45db-ba2b-04a220669a74 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:07:12.644887 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-6e03ea64-61cf-45db-ba2b-04a220669a74 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:07:12.769488 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-6e03ea64-61cf-45db-ba2b-04a220669a74 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e40b7f3da047fcbea943e7f1206bcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee581f47a5419098d02102081f617d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:07:12.776924 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-6e03ea64-61cf-45db-ba2b-04a220669a74 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] 10.222.0.17 "GET /compute/v2.1/servers/906439ae-f5b3-40f5-a7ea-9d308866247a" status: 200 len: 1496 microversion: 2.1 time: 0.147609 Jun 16 23:07:12.777974 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 455/895] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:07:12 2022] GET /compute/v2.1/servers/906439ae-f5b3-40f5-a7ea-9d308866247a => generated 1496 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:07:13.217530 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-677fc9f4-c921-460d-97f0-0995d654fdcf tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:07:13.221782 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-677fc9f4-c921-460d-97f0-0995d654fdcf tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] [instance: 906439ae-f5b3-40f5-a7ea-9d308866247a] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:07:13.224823 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-677fc9f4-c921-460d-97f0-0995d654fdcf tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:07:13.225270 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-677fc9f4-c921-460d-97f0-0995d654fdcf tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:07:13.226025 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-677fc9f4-c921-460d-97f0-0995d654fdcf tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:07:13.226453 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-677fc9f4-c921-460d-97f0-0995d654fdcf tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:07:13.248235 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG dbcounter [-] [117563] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 23:07:13.256460 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-677fc9f4-c921-460d-97f0-0995d654fdcf tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] [instance: 906439ae-f5b3-40f5-a7ea-9d308866247a] Going to try to terminate instance {{(pid=117563) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 23:07:13.331461 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-677fc9f4-c921-460d-97f0-0995d654fdcf tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] 10.222.0.17 "DELETE /compute/v2.1/servers/906439ae-f5b3-40f5-a7ea-9d308866247a" status: 204 len: 0 microversion: 2.1 time: 0.118446 Jun 16 23:07:13.332102 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 441/896] 10.222.0.17 () {58 vars in 1238 bytes} [Thu Jun 16 23:07:13 2022] DELETE /compute/v2.1/servers/906439ae-f5b3-40f5-a7ea-9d308866247a => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 23:07:13.341260 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-8ab4011a-b1b1-4b01-a2a5-f0ba977379aa tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:07:13.341260 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-8ab4011a-b1b1-4b01-a2a5-f0ba977379aa tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] [instance: 906439ae-f5b3-40f5-a7ea-9d308866247a] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:07:13.347443 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-8ab4011a-b1b1-4b01-a2a5-f0ba977379aa tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:07:13.347891 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-8ab4011a-b1b1-4b01-a2a5-f0ba977379aa tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:07:13.348656 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-8ab4011a-b1b1-4b01-a2a5-f0ba977379aa tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:07:13.349090 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-8ab4011a-b1b1-4b01-a2a5-f0ba977379aa tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:07:13.478198 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-8ab4011a-b1b1-4b01-a2a5-f0ba977379aa tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e40b7f3da047fcbea943e7f1206bcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee581f47a5419098d02102081f617d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:07:13.485539 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-8ab4011a-b1b1-4b01-a2a5-f0ba977379aa tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] 10.222.0.17 "GET /compute/v2.1/servers/906439ae-f5b3-40f5-a7ea-9d308866247a" status: 200 len: 1502 microversion: 2.1 time: 0.149229 Jun 16 23:07:13.486160 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 456/897] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:07:13 2022] GET /compute/v2.1/servers/906439ae-f5b3-40f5-a7ea-9d308866247a => generated 1502 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:07:14.503823 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-f5d4c8ef-cc17-4d4a-8a76-684ed158d46d tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:07:14.504527 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-f5d4c8ef-cc17-4d4a-8a76-684ed158d46d tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] [instance: 906439ae-f5b3-40f5-a7ea-9d308866247a] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:07:14.511648 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-f5d4c8ef-cc17-4d4a-8a76-684ed158d46d tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:07:14.512113 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-f5d4c8ef-cc17-4d4a-8a76-684ed158d46d tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:07:14.512884 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-f5d4c8ef-cc17-4d4a-8a76-684ed158d46d tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:07:14.513328 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-f5d4c8ef-cc17-4d4a-8a76-684ed158d46d tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:07:14.640474 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-f5d4c8ef-cc17-4d4a-8a76-684ed158d46d tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e40b7f3da047fcbea943e7f1206bcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee581f47a5419098d02102081f617d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:07:14.647936 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-f5d4c8ef-cc17-4d4a-8a76-684ed158d46d tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] 10.222.0.17 "GET /compute/v2.1/servers/906439ae-f5b3-40f5-a7ea-9d308866247a" status: 200 len: 1502 microversion: 2.1 time: 0.148382 Jun 16 23:07:14.648501 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 442/898] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:07:14 2022] GET /compute/v2.1/servers/906439ae-f5b3-40f5-a7ea-9d308866247a => generated 1502 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:07:15.083525 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-7dccf623-f45b-4038-a044-d6f95a8e3182 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:07:15.084006 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-7dccf623-f45b-4038-a044-d6f95a8e3182 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] [instance: 07404710-1539-46ee-b4ff-2ef30af07f8e] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:07:15.090922 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-7dccf623-f45b-4038-a044-d6f95a8e3182 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:07:15.091352 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-7dccf623-f45b-4038-a044-d6f95a8e3182 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:07:15.092138 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-7dccf623-f45b-4038-a044-d6f95a8e3182 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:07:15.092600 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-7dccf623-f45b-4038-a044-d6f95a8e3182 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:07:15.124561 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-7dccf623-f45b-4038-a044-d6f95a8e3182 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] 10.222.0.17 "GET /compute/v2.1/servers/07404710-1539-46ee-b4ff-2ef30af07f8e/ips" status: 200 len: 148 microversion: 2.1 time: 0.044848 Jun 16 23:07:15.125127 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 457/899] 10.222.0.17 () {58 vars in 1247 bytes} [Thu Jun 16 23:07:15 2022] GET /compute/v2.1/servers/07404710-1539-46ee-b4ff-2ef30af07f8e/ips => generated 148 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 23:07:15.346292 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [req-ba857ac2-e252-4dc6-a9b3-004b4264a93c req-31accd05-34bf-414a-ac5e-8113150da28a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "906439ae-f5b3-40f5-a7ea-9d308866247a", "name": "network-vif-deleted", "tag": "8c72756a-f229-4045-b37e-534047055292"}]} {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 23:07:15.356808 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-ba857ac2-e252-4dc6-a9b3-004b4264a93c req-31accd05-34bf-414a-ac5e-8113150da28a service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:07:15.357263 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-ba857ac2-e252-4dc6-a9b3-004b4264a93c req-31accd05-34bf-414a-ac5e-8113150da28a service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:07:15.371350 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.compute.server_external_events [req-ba857ac2-e252-4dc6-a9b3-004b4264a93c req-31accd05-34bf-414a-ac5e-8113150da28a service nova] Creating event network-vif-deleted:8c72756a-f229-4045-b37e-534047055292 for instance 906439ae-f5b3-40f5-a7ea-9d308866247a on hv-cinder-84623 Jun 16 23:07:15.377849 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [req-ba857ac2-e252-4dc6-a9b3-004b4264a93c req-31accd05-34bf-414a-ac5e-8113150da28a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035404 Jun 16 23:07:15.378637 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 443/900] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 23:07:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 23:07:15.665468 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-87484696-5e9c-423d-99dd-02c233181484 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:07:15.666107 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-87484696-5e9c-423d-99dd-02c233181484 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] [instance: 906439ae-f5b3-40f5-a7ea-9d308866247a] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:07:15.672108 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-87484696-5e9c-423d-99dd-02c233181484 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:07:15.672553 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-87484696-5e9c-423d-99dd-02c233181484 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:07:15.673312 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-87484696-5e9c-423d-99dd-02c233181484 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:07:15.673746 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-87484696-5e9c-423d-99dd-02c233181484 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:07:15.707079 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-87484696-5e9c-423d-99dd-02c233181484 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:07:15.707595 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-87484696-5e9c-423d-99dd-02c233181484 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:07:15.708037 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.objects.instance [None req-87484696-5e9c-423d-99dd-02c233181484 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lazy-loading 'fault' on Instance uuid 906439ae-f5b3-40f5-a7ea-9d308866247a {{(pid=117562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 23:07:15.749855 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-87484696-5e9c-423d-99dd-02c233181484 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e40b7f3da047fcbea943e7f1206bcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee581f47a5419098d02102081f617d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:07:15.757402 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-87484696-5e9c-423d-99dd-02c233181484 tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] 10.222.0.17 "GET /compute/v2.1/servers/906439ae-f5b3-40f5-a7ea-9d308866247a" status: 200 len: 1303 microversion: 2.1 time: 0.096044 Jun 16 23:07:15.757958 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 458/901] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:07:15 2022] GET /compute/v2.1/servers/906439ae-f5b3-40f5-a7ea-9d308866247a => generated 1303 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:07:16.474938 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-766da1fb-7c82-474a-8e66-f44f3f4465d0 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8cdb86ed-3ffb-489b-bb63-3fdd38357da4"}} {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 23:07:16.476073 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-766da1fb-7c82-474a-8e66-f44f3f4465d0 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] [instance: 07404710-1539-46ee-b4ff-2ef30af07f8e] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:07:16.483549 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-766da1fb-7c82-474a-8e66-f44f3f4465d0 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:07:16.483999 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-766da1fb-7c82-474a-8e66-f44f3f4465d0 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:07:16.484788 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-766da1fb-7c82-474a-8e66-f44f3f4465d0 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:07:16.485220 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-766da1fb-7c82-474a-8e66-f44f3f4465d0 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:07:16.775110 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-d2d4bf0b-2477-46df-8ff6-78c123f9d9bc tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:07:16.775653 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-d2d4bf0b-2477-46df-8ff6-78c123f9d9bc tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] [instance: 906439ae-f5b3-40f5-a7ea-9d308866247a] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:07:16.782698 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-d2d4bf0b-2477-46df-8ff6-78c123f9d9bc tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:07:16.783149 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-d2d4bf0b-2477-46df-8ff6-78c123f9d9bc tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:07:16.783914 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-d2d4bf0b-2477-46df-8ff6-78c123f9d9bc tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:07:16.784352 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-d2d4bf0b-2477-46df-8ff6-78c123f9d9bc tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:07:16.813911 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-d2d4bf0b-2477-46df-8ff6-78c123f9d9bc tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:07:16.814359 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-d2d4bf0b-2477-46df-8ff6-78c123f9d9bc tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:07:16.814837 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.objects.instance [None req-d2d4bf0b-2477-46df-8ff6-78c123f9d9bc tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lazy-loading 'fault' on Instance uuid 906439ae-f5b3-40f5-a7ea-9d308866247a {{(pid=117562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 23:07:16.862136 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-d2d4bf0b-2477-46df-8ff6-78c123f9d9bc tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e40b7f3da047fcbea943e7f1206bcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ee581f47a5419098d02102081f617d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:07:16.870986 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-d2d4bf0b-2477-46df-8ff6-78c123f9d9bc tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] 10.222.0.17 "GET /compute/v2.1/servers/906439ae-f5b3-40f5-a7ea-9d308866247a" status: 200 len: 1303 microversion: 2.1 time: 0.099599 Jun 16 23:07:16.871608 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 459/902] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:07:16 2022] GET /compute/v2.1/servers/906439ae-f5b3-40f5-a7ea-9d308866247a => generated 1303 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 23:07:17.004371 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-766da1fb-7c82-474a-8e66-f44f3f4465d0 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] 10.222.0.17 "POST /compute/v2.1/servers/07404710-1539-46ee-b4ff-2ef30af07f8e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.533442 Jun 16 23:07:17.006631 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 444/903] 10.222.0.17 () {60 vars in 1322 bytes} [Thu Jun 16 23:07:16 2022] POST /compute/v2.1/servers/07404710-1539-46ee-b4ff-2ef30af07f8e/os-volume_attachments => generated 194 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 23:07:17.265267 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-47d69445-8763-4e23-9112-556b1ac0f536 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:07:17.266345 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-47d69445-8763-4e23-9112-556b1ac0f536 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] [instance: b7619c39-737f-440b-b676-8e920380d6c6] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:07:17.272310 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-47d69445-8763-4e23-9112-556b1ac0f536 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:07:17.272764 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-47d69445-8763-4e23-9112-556b1ac0f536 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:07:17.273527 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-47d69445-8763-4e23-9112-556b1ac0f536 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:07:17.273967 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-47d69445-8763-4e23-9112-556b1ac0f536 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:07:17.302490 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-47d69445-8763-4e23-9112-556b1ac0f536 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] 10.222.0.17 "GET /compute/v2.1/servers/b7619c39-737f-440b-b676-8e920380d6c6/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.041607 Jun 16 23:07:17.302987 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 460/904] 10.222.0.17 () {58 vars in 1301 bytes} [Thu Jun 16 23:07:17 2022] GET /compute/v2.1/servers/b7619c39-737f-440b-b676-8e920380d6c6/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 23:07:17.445110 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-f6a76978-5f93-46d5-b468-f154d012ba7d tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:07:17.445614 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-f6a76978-5f93-46d5-b468-f154d012ba7d tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] [instance: b7619c39-737f-440b-b676-8e920380d6c6] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:07:17.452236 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-f6a76978-5f93-46d5-b468-f154d012ba7d tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:07:17.452684 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-f6a76978-5f93-46d5-b468-f154d012ba7d tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:07:17.453506 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-f6a76978-5f93-46d5-b468-f154d012ba7d tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:07:17.453947 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-f6a76978-5f93-46d5-b468-f154d012ba7d tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:07:17.486271 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-f6a76978-5f93-46d5-b468-f154d012ba7d tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] 10.222.0.17 "GET /compute/v2.1/servers/b7619c39-737f-440b-b676-8e920380d6c6/os-volume_attachments/456f85b5-0d99-4809-a886-316018a40337" status: 200 len: 194 microversion: 2.1 time: 0.046226 Jun 16 23:07:17.487310 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 445/905] 10.222.0.17 () {58 vars in 1412 bytes} [Thu Jun 16 23:07:17 2022] GET /compute/v2.1/servers/b7619c39-737f-440b-b676-8e920380d6c6/os-volume_attachments/456f85b5-0d99-4809-a886-316018a40337 => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 23:07:17.497595 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-ec051ee1-fe1e-475c-a59a-0cb01af15d04 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:07:17.498088 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-ec051ee1-fe1e-475c-a59a-0cb01af15d04 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] [instance: b7619c39-737f-440b-b676-8e920380d6c6] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:07:17.504068 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-ec051ee1-fe1e-475c-a59a-0cb01af15d04 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:07:17.504519 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-ec051ee1-fe1e-475c-a59a-0cb01af15d04 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:07:17.505282 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-ec051ee1-fe1e-475c-a59a-0cb01af15d04 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:07:17.505721 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-ec051ee1-fe1e-475c-a59a-0cb01af15d04 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:07:17.584476 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.objects.instance [None req-ec051ee1-fe1e-475c-a59a-0cb01af15d04 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lazy-loading 'services' on Instance uuid b7619c39-737f-440b-b676-8e920380d6c6 {{(pid=117562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 23:07:17.587765 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG dbcounter [-] [117562] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 23:07:17.655485 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-ec051ee1-fe1e-475c-a59a-0cb01af15d04 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] 10.222.0.17 "DELETE /compute/v2.1/servers/b7619c39-737f-440b-b676-8e920380d6c6/os-volume_attachments/456f85b5-0d99-4809-a886-316018a40337" status: 202 len: 0 microversion: 2.1 time: 0.162254 Jun 16 23:07:17.656251 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 461/906] 10.222.0.17 () {58 vars in 1415 bytes} [Thu Jun 16 23:07:17 2022] DELETE /compute/v2.1/servers/b7619c39-737f-440b-b676-8e920380d6c6/os-volume_attachments/456f85b5-0d99-4809-a886-316018a40337 => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 16 23:07:17.888036 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-dcd101e2-407d-401a-b8b3-fe70588b714f tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:07:17.888650 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-dcd101e2-407d-401a-b8b3-fe70588b714f tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] [instance: 906439ae-f5b3-40f5-a7ea-9d308866247a] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:07:17.895137 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-dcd101e2-407d-401a-b8b3-fe70588b714f tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:07:17.895594 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-dcd101e2-407d-401a-b8b3-fe70588b714f tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:07:17.896360 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-dcd101e2-407d-401a-b8b3-fe70588b714f tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:07:17.896804 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-dcd101e2-407d-401a-b8b3-fe70588b714f tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:07:17.909912 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.wsgi [None req-dcd101e2-407d-401a-b8b3-fe70588b714f tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] HTTP exception thrown: Instance 906439ae-f5b3-40f5-a7ea-9d308866247a could not be found. Jun 16 23:07:17.911557 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-dcd101e2-407d-401a-b8b3-fe70588b714f tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Request method failure captured: Jun 16 23:07:17.911557 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: request: GET /compute/v2.1/servers/906439ae-f5b3-40f5-a7ea-9d308866247a HTTP/1.1 Jun 16 23:07:17.911557 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Accept: application/json Jun 16 23:07:17.911557 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Accept-Encoding: identity Jun 16 23:07:17.911557 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Connection: close Jun 16 23:07:17.911557 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Content-Length: 0 Jun 16 23:07:17.911557 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Content-Type: application/json Jun 16 23:07:17.911557 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Host: 10.222.0.17 Jun 16 23:07:17.911557 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Openstack-System-Scope: None Jun 16 23:07:17.911557 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: User-Agent: python-urllib3/1.26.9 Jun 16 23:07:17.911557 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Auth-Token: gAAAAABiq7d2dvJIRUCd2Q9JNTXpOkwWBGhmncBh-nTTKV2P1VF6dkPSKTtgBh9_RAyZJ1xRMXK9ZQp7XogvI4_A5DvS4QqgWpwqftVLM_eG-SILS6qmyBcea6UbfCbdPfaRQGZCV30_B3U89jm6RnfAuBvv9oQhAfq9xDeA04w7kRsb0Z1ScZs Jun 16 23:07:17.911557 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Domain-Id: None Jun 16 23:07:17.911557 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Domain-Name: None Jun 16 23:07:17.911557 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Identity-Status: Confirmed Jun 16 23:07:17.911557 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Is-Admin-Project: True Jun 16 23:07:17.911557 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Project-Domain-Id: default Jun 16 23:07:17.911557 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Project-Domain-Name: Default Jun 16 23:07:17.911557 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Project-Id: 91ee581f47a5419098d02102081f617d Jun 16 23:07:17.911557 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Project-Name: tempest-VolumesActionsTest-716400687 Jun 16 23:07:17.911557 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Role: member,reader Jun 16 23:07:17.911557 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Roles: member,reader Jun 16 23:07:17.913092 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/91ee581f47a5419098d02102081f617d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_91ee581f47a5419098d02102081f617d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/91ee581f47a5419098d02102081f617d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/91ee581f47a5419098d02102081f617d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Jun 16 23:07:17.913092 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Tenant: tempest-VolumesActionsTest-716400687 Jun 16 23:07:17.913092 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Tenant-Id: 91ee581f47a5419098d02102081f617d Jun 16 23:07:17.913092 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Tenant-Name: tempest-VolumesActionsTest-716400687 Jun 16 23:07:17.913092 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-User: tempest-VolumesActionsTest-716400687-project Jun 16 23:07:17.913092 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-User-Domain-Id: default Jun 16 23:07:17.913092 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-User-Domain-Name: Default Jun 16 23:07:17.913092 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-User-Id: 61e40b7f3da047fcbea943e7f1206bcb Jun 16 23:07:17.913092 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-User-Name: tempest-VolumesActionsTest-716400687-project Jun 16 23:07:17.913092 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: method: > Jun 16 23:07:17.913092 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: exception: Instance 906439ae-f5b3-40f5-a7ea-9d308866247a could not be found. Jun 16 23:07:17.913092 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: action_args: {'id': '906439ae-f5b3-40f5-a7ea-9d308866247a'} Jun 16 23:07:17.913972 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 23:07:17.913972 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 23:07:17.913972 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 23:07:17.913972 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 23:07:17.913972 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 23:07:17.913972 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 23:07:17.913972 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 23:07:17.913972 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 23:07:17.913972 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 23:07:17.913972 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 23:07:17.913972 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 906439ae-f5b3-40f5-a7ea-9d308866247a could not be found. Jun 16 23:07:17.913972 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 16 23:07:17.913972 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 23:07:17.913972 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 16 23:07:17.913972 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 23:07:17.913972 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 23:07:17.913972 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 23:07:17.913972 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 23:07:17.913972 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 23:07:17.913972 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 23:07:17.915450 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 23:07:17.915450 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 23:07:17.915450 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 23:07:17.915450 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 23:07:17.915450 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 23:07:17.915450 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 23:07:17.915450 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 23:07:17.915450 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 906439ae-f5b3-40f5-a7ea-9d308866247a could not be found. Jun 16 23:07:17.915450 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 16 23:07:17.915450 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 23:07:17.915450 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 16 23:07:17.915450 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 23:07:17.915450 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 23:07:17.915450 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 23:07:17.915450 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 23:07:17.915450 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 23:07:17.915450 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 906439ae-f5b3-40f5-a7ea-9d308866247a could not be found. Jun 16 23:07:17.915450 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 16 23:07:17.917244 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-dcd101e2-407d-401a-b8b3-fe70588b714f tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] Returning 404 to user: Instance 906439ae-f5b3-40f5-a7ea-9d308866247a could not be found. {{(pid=117563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 23:07:17.917244 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-dcd101e2-407d-401a-b8b3-fe70588b714f tempest-VolumesActionsTest-716400687 tempest-VolumesActionsTest-716400687-project] 10.222.0.17 "GET /compute/v2.1/servers/906439ae-f5b3-40f5-a7ea-9d308866247a" status: 404 len: 111 microversion: 2.1 time: 0.029415 Jun 16 23:07:17.917244 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 446/907] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:07:17 2022] GET /compute/v2.1/servers/906439ae-f5b3-40f5-a7ea-9d308866247a => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 23:07:20.893316 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-64103617-50b9-4341-a647-bb7c00a08607 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:07:20.893908 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-64103617-50b9-4341-a647-bb7c00a08607 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] [instance: aa81794d-bc81-49d2-b4dc-6f57b43ecfe8] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:07:20.898040 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [req-755b9ee9-1185-4f7b-a99a-183dbc6355dc req-2814b29f-1209-43a2-80c9-73ee2a89ae4a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa81794d-bc81-49d2-b4dc-6f57b43ecfe8", "tag": "218d229b-a7e5-4c33-9723-c6215e47e600"}]} {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 23:07:20.900789 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-64103617-50b9-4341-a647-bb7c00a08607 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:07:20.901242 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-64103617-50b9-4341-a647-bb7c00a08607 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:07:20.902017 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-64103617-50b9-4341-a647-bb7c00a08607 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:07:20.902453 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-64103617-50b9-4341-a647-bb7c00a08607 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:07:20.906787 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-755b9ee9-1185-4f7b-a99a-183dbc6355dc req-2814b29f-1209-43a2-80c9-73ee2a89ae4a service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:07:20.907240 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-755b9ee9-1185-4f7b-a99a-183dbc6355dc req-2814b29f-1209-43a2-80c9-73ee2a89ae4a service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:07:20.918271 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.compute.server_external_events [req-755b9ee9-1185-4f7b-a99a-183dbc6355dc req-2814b29f-1209-43a2-80c9-73ee2a89ae4a service nova] Creating event network-changed:218d229b-a7e5-4c33-9723-c6215e47e600 for instance aa81794d-bc81-49d2-b4dc-6f57b43ecfe8 on hv-cinder-84623 Jun 16 23:07:20.923539 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [req-755b9ee9-1185-4f7b-a99a-183dbc6355dc req-2814b29f-1209-43a2-80c9-73ee2a89ae4a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029530 Jun 16 23:07:20.924226 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 447/908] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 23:07:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 23:07:20.928598 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-64103617-50b9-4341-a647-bb7c00a08607 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] [instance: aa81794d-bc81-49d2-b4dc-6f57b43ecfe8] Going to try to terminate instance {{(pid=117562) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 23:07:21.005396 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-64103617-50b9-4341-a647-bb7c00a08607 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] 10.222.0.17 "DELETE /compute/v2.1/servers/aa81794d-bc81-49d2-b4dc-6f57b43ecfe8" status: 204 len: 0 microversion: 2.1 time: 0.116487 Jun 16 23:07:21.005911 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 462/909] 10.222.0.17 () {58 vars in 1238 bytes} [Thu Jun 16 23:07:20 2022] DELETE /compute/v2.1/servers/aa81794d-bc81-49d2-b4dc-6f57b43ecfe8 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 23:07:21.015124 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-69cf94f0-68fe-4ae4-bc0d-b092361e8d1d tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:07:21.015951 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-69cf94f0-68fe-4ae4-bc0d-b092361e8d1d tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] [instance: aa81794d-bc81-49d2-b4dc-6f57b43ecfe8] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:07:21.022137 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-69cf94f0-68fe-4ae4-bc0d-b092361e8d1d tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:07:21.022702 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-69cf94f0-68fe-4ae4-bc0d-b092361e8d1d tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:07:21.023568 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-69cf94f0-68fe-4ae4-bc0d-b092361e8d1d tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:07:21.024085 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-69cf94f0-68fe-4ae4-bc0d-b092361e8d1d tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:07:21.157699 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-69cf94f0-68fe-4ae4-bc0d-b092361e8d1d tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01dd0e5661f44d05a01d7a5e82dbadf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b30b90ec4d5e45468a4fa0fb98e46393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:07:21.165324 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-69cf94f0-68fe-4ae4-bc0d-b092361e8d1d tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] 10.222.0.17 "GET /compute/v2.1/servers/aa81794d-bc81-49d2-b4dc-6f57b43ecfe8" status: 200 len: 1567 microversion: 2.1 time: 0.155090 Jun 16 23:07:21.166093 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 448/910] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:07:21 2022] GET /compute/v2.1/servers/aa81794d-bc81-49d2-b4dc-6f57b43ecfe8 => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:07:22.183386 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-8e5b5db8-e1fe-4c94-94ec-a5e6d87d7697 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:07:22.184065 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-8e5b5db8-e1fe-4c94-94ec-a5e6d87d7697 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] [instance: aa81794d-bc81-49d2-b4dc-6f57b43ecfe8] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:07:22.190460 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-8e5b5db8-e1fe-4c94-94ec-a5e6d87d7697 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:07:22.190940 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-8e5b5db8-e1fe-4c94-94ec-a5e6d87d7697 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:07:22.191724 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-8e5b5db8-e1fe-4c94-94ec-a5e6d87d7697 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:07:22.192141 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-8e5b5db8-e1fe-4c94-94ec-a5e6d87d7697 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:07:22.331705 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-8e5b5db8-e1fe-4c94-94ec-a5e6d87d7697 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01dd0e5661f44d05a01d7a5e82dbadf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b30b90ec4d5e45468a4fa0fb98e46393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:07:22.339305 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-8e5b5db8-e1fe-4c94-94ec-a5e6d87d7697 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] 10.222.0.17 "GET /compute/v2.1/servers/aa81794d-bc81-49d2-b4dc-6f57b43ecfe8" status: 200 len: 1567 microversion: 2.1 time: 0.160180 Jun 16 23:07:22.339851 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 463/911] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:07:22 2022] GET /compute/v2.1/servers/aa81794d-bc81-49d2-b4dc-6f57b43ecfe8 => generated 1567 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:07:23.356697 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-eb576a84-84af-4c08-a960-981b3e1826ad tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:07:23.357936 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-eb576a84-84af-4c08-a960-981b3e1826ad tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] [instance: aa81794d-bc81-49d2-b4dc-6f57b43ecfe8] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:07:23.368015 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-eb576a84-84af-4c08-a960-981b3e1826ad tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:07:23.368881 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-eb576a84-84af-4c08-a960-981b3e1826ad tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:07:23.369859 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-eb576a84-84af-4c08-a960-981b3e1826ad tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:07:23.370713 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-eb576a84-84af-4c08-a960-981b3e1826ad tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:07:23.549566 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-eb576a84-84af-4c08-a960-981b3e1826ad tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01dd0e5661f44d05a01d7a5e82dbadf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b30b90ec4d5e45468a4fa0fb98e46393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:07:23.558119 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-eb576a84-84af-4c08-a960-981b3e1826ad tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] 10.222.0.17 "GET /compute/v2.1/servers/aa81794d-bc81-49d2-b4dc-6f57b43ecfe8" status: 200 len: 1567 microversion: 2.1 time: 0.205643 Jun 16 23:07:23.559533 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 449/912] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:07:23 2022] GET /compute/v2.1/servers/aa81794d-bc81-49d2-b4dc-6f57b43ecfe8 => generated 1567 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:07:24.402224 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [req-b3836e73-1395-45d1-993c-2e89bd432487 req-4789d7b9-5801-4388-9592-ed9a778b97c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa81794d-bc81-49d2-b4dc-6f57b43ecfe8", "name": "network-vif-deleted", "tag": "218d229b-a7e5-4c33-9723-c6215e47e600"}]} {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 23:07:24.412078 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [req-b3836e73-1395-45d1-993c-2e89bd432487 req-4789d7b9-5801-4388-9592-ed9a778b97c4 service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:07:24.412874 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [req-b3836e73-1395-45d1-993c-2e89bd432487 req-4789d7b9-5801-4388-9592-ed9a778b97c4 service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:07:24.427487 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.compute.server_external_events [req-b3836e73-1395-45d1-993c-2e89bd432487 req-4789d7b9-5801-4388-9592-ed9a778b97c4 service nova] Creating event network-vif-deleted:218d229b-a7e5-4c33-9723-c6215e47e600 for instance aa81794d-bc81-49d2-b4dc-6f57b43ecfe8 on hv-cinder-84623 Jun 16 23:07:24.433271 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [req-b3836e73-1395-45d1-993c-2e89bd432487 req-4789d7b9-5801-4388-9592-ed9a778b97c4 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034909 Jun 16 23:07:24.435394 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 464/913] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 23:07:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 23:07:24.582007 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-d761f711-8941-43f1-bb51-cbef22e6f4cb tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:07:24.582654 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-d761f711-8941-43f1-bb51-cbef22e6f4cb tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] [instance: aa81794d-bc81-49d2-b4dc-6f57b43ecfe8] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:07:24.591002 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-d761f711-8941-43f1-bb51-cbef22e6f4cb tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:07:24.591471 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-d761f711-8941-43f1-bb51-cbef22e6f4cb tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:07:24.592375 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-d761f711-8941-43f1-bb51-cbef22e6f4cb tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:07:24.593117 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-d761f711-8941-43f1-bb51-cbef22e6f4cb tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:07:24.662472 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-00a6f942-b2d6-41e9-a1a0-befd970fa124 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:07:24.662472 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-00a6f942-b2d6-41e9-a1a0-befd970fa124 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] [instance: 07404710-1539-46ee-b4ff-2ef30af07f8e] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:07:24.679165 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-00a6f942-b2d6-41e9-a1a0-befd970fa124 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:07:24.679679 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-00a6f942-b2d6-41e9-a1a0-befd970fa124 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:07:24.680501 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-00a6f942-b2d6-41e9-a1a0-befd970fa124 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:07:24.680938 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-00a6f942-b2d6-41e9-a1a0-befd970fa124 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:07:24.694194 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-d761f711-8941-43f1-bb51-cbef22e6f4cb tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01dd0e5661f44d05a01d7a5e82dbadf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b30b90ec4d5e45468a4fa0fb98e46393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:07:24.707305 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-d761f711-8941-43f1-bb51-cbef22e6f4cb tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] 10.222.0.17 "GET /compute/v2.1/servers/aa81794d-bc81-49d2-b4dc-6f57b43ecfe8" status: 200 len: 1500 microversion: 2.1 time: 0.134896 Jun 16 23:07:24.708298 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 450/914] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:07:24 2022] GET /compute/v2.1/servers/aa81794d-bc81-49d2-b4dc-6f57b43ecfe8 => generated 1500 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:07:25.090267 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.objects.instance [None req-00a6f942-b2d6-41e9-a1a0-befd970fa124 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lazy-loading 'services' on Instance uuid 07404710-1539-46ee-b4ff-2ef30af07f8e {{(pid=117562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 23:07:25.180125 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-c499d25d-2f79-4d80-9440-0f3f1b8abced tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:07:25.180626 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-c499d25d-2f79-4d80-9440-0f3f1b8abced tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] [instance: b7619c39-737f-440b-b676-8e920380d6c6] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:07:25.190764 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-c499d25d-2f79-4d80-9440-0f3f1b8abced tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:07:25.191225 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-c499d25d-2f79-4d80-9440-0f3f1b8abced tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:07:25.192013 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-c499d25d-2f79-4d80-9440-0f3f1b8abced tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:07:25.194913 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-c499d25d-2f79-4d80-9440-0f3f1b8abced tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:07:25.217808 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-00a6f942-b2d6-41e9-a1a0-befd970fa124 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] 10.222.0.17 "DELETE /compute/v2.1/servers/07404710-1539-46ee-b4ff-2ef30af07f8e/os-volume_attachments/8cdb86ed-3ffb-489b-bb63-3fdd38357da4" status: 202 len: 0 microversion: 2.1 time: 0.561358 Jun 16 23:07:25.228815 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 465/915] 10.222.0.17 () {58 vars in 1415 bytes} [Thu Jun 16 23:07:24 2022] DELETE /compute/v2.1/servers/07404710-1539-46ee-b4ff-2ef30af07f8e/os-volume_attachments/8cdb86ed-3ffb-489b-bb63-3fdd38357da4 => generated 0 bytes in 573 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 23:07:25.245815 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-35e554e1-802a-4344-b736-fc6831953bf3 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:07:25.248347 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-35e554e1-802a-4344-b736-fc6831953bf3 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] [instance: 07404710-1539-46ee-b4ff-2ef30af07f8e] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:07:25.264631 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-35e554e1-802a-4344-b736-fc6831953bf3 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:07:25.269489 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-35e554e1-802a-4344-b736-fc6831953bf3 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:07:25.274074 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-35e554e1-802a-4344-b736-fc6831953bf3 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:07:25.275038 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-35e554e1-802a-4344-b736-fc6831953bf3 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:07:25.281489 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-c499d25d-2f79-4d80-9440-0f3f1b8abced tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] 10.222.0.17 "GET /compute/v2.1/servers/b7619c39-737f-440b-b676-8e920380d6c6/os-volume_attachments/4dbfeb0f-9dd0-454b-b47f-83c3709b77d4" status: 200 len: 194 microversion: 2.1 time: 0.105762 Jun 16 23:07:25.286638 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 451/916] 10.222.0.17 () {58 vars in 1412 bytes} [Thu Jun 16 23:07:25 2022] GET /compute/v2.1/servers/b7619c39-737f-440b-b676-8e920380d6c6/os-volume_attachments/4dbfeb0f-9dd0-454b-b47f-83c3709b77d4 => generated 194 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 23:07:25.295318 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-6bd0103f-2eb1-4832-a228-84737851da15 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:07:25.295819 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-6bd0103f-2eb1-4832-a228-84737851da15 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] [instance: b7619c39-737f-440b-b676-8e920380d6c6] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:07:25.302331 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-6bd0103f-2eb1-4832-a228-84737851da15 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:07:25.302915 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-6bd0103f-2eb1-4832-a228-84737851da15 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:07:25.303654 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-6bd0103f-2eb1-4832-a228-84737851da15 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:07:25.304088 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-6bd0103f-2eb1-4832-a228-84737851da15 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:07:25.335108 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-35e554e1-802a-4344-b736-fc6831953bf3 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] 10.222.0.17 "GET /compute/v2.1/servers/07404710-1539-46ee-b4ff-2ef30af07f8e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.104245 Jun 16 23:07:25.335688 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 466/917] 10.222.0.17 () {58 vars in 1301 bytes} [Thu Jun 16 23:07:25 2022] GET /compute/v2.1/servers/07404710-1539-46ee-b4ff-2ef30af07f8e/os-volume_attachments => generated 197 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 23:07:25.426960 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.objects.instance [None req-6bd0103f-2eb1-4832-a228-84737851da15 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lazy-loading 'services' on Instance uuid b7619c39-737f-440b-b676-8e920380d6c6 {{(pid=117563) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 23:07:25.518634 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-6bd0103f-2eb1-4832-a228-84737851da15 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] 10.222.0.17 "DELETE /compute/v2.1/servers/b7619c39-737f-440b-b676-8e920380d6c6/os-volume_attachments/4dbfeb0f-9dd0-454b-b47f-83c3709b77d4" status: 202 len: 0 microversion: 2.1 time: 0.220369 Jun 16 23:07:25.518634 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 452/918] 10.222.0.17 () {58 vars in 1415 bytes} [Thu Jun 16 23:07:25 2022] DELETE /compute/v2.1/servers/b7619c39-737f-440b-b676-8e920380d6c6/os-volume_attachments/4dbfeb0f-9dd0-454b-b47f-83c3709b77d4 => generated 0 bytes in 222 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 23:07:25.724897 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-c45af8d1-96fe-4e26-850e-2a85c7ae2ce6 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:07:25.725520 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-c45af8d1-96fe-4e26-850e-2a85c7ae2ce6 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] [instance: aa81794d-bc81-49d2-b4dc-6f57b43ecfe8] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:07:25.735681 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-c45af8d1-96fe-4e26-850e-2a85c7ae2ce6 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:07:25.739161 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-c45af8d1-96fe-4e26-850e-2a85c7ae2ce6 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:07:25.740448 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-c45af8d1-96fe-4e26-850e-2a85c7ae2ce6 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:07:25.740945 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-c45af8d1-96fe-4e26-850e-2a85c7ae2ce6 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:07:25.787420 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-c45af8d1-96fe-4e26-850e-2a85c7ae2ce6 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:07:25.787870 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-c45af8d1-96fe-4e26-850e-2a85c7ae2ce6 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:07:25.788315 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.objects.instance [None req-c45af8d1-96fe-4e26-850e-2a85c7ae2ce6 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lazy-loading 'fault' on Instance uuid aa81794d-bc81-49d2-b4dc-6f57b43ecfe8 {{(pid=117562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 23:07:25.830619 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-c45af8d1-96fe-4e26-850e-2a85c7ae2ce6 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01dd0e5661f44d05a01d7a5e82dbadf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b30b90ec4d5e45468a4fa0fb98e46393', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:07:25.839213 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-c45af8d1-96fe-4e26-850e-2a85c7ae2ce6 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] 10.222.0.17 "GET /compute/v2.1/servers/aa81794d-bc81-49d2-b4dc-6f57b43ecfe8" status: 200 len: 1387 microversion: 2.1 time: 0.118563 Jun 16 23:07:25.840023 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 467/919] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:07:25 2022] GET /compute/v2.1/servers/aa81794d-bc81-49d2-b4dc-6f57b43ecfe8 => generated 1387 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:07:26.348244 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-041750a2-a384-4a4d-adeb-811dbba4bcc0 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:07:26.349365 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-041750a2-a384-4a4d-adeb-811dbba4bcc0 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] [instance: 07404710-1539-46ee-b4ff-2ef30af07f8e] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:07:26.360438 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-041750a2-a384-4a4d-adeb-811dbba4bcc0 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:07:26.361413 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-041750a2-a384-4a4d-adeb-811dbba4bcc0 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:07:26.362364 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-041750a2-a384-4a4d-adeb-811dbba4bcc0 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:07:26.363024 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-041750a2-a384-4a4d-adeb-811dbba4bcc0 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:07:26.404938 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-041750a2-a384-4a4d-adeb-811dbba4bcc0 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] 10.222.0.17 "GET /compute/v2.1/servers/07404710-1539-46ee-b4ff-2ef30af07f8e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061537 Jun 16 23:07:26.410331 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 453/920] 10.222.0.17 () {58 vars in 1301 bytes} [Thu Jun 16 23:07:26 2022] GET /compute/v2.1/servers/07404710-1539-46ee-b4ff-2ef30af07f8e/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 23:07:26.860736 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-31f2f372-68d4-42d9-b663-b7af074d9a99 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:07:26.861842 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-31f2f372-68d4-42d9-b663-b7af074d9a99 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] [instance: aa81794d-bc81-49d2-b4dc-6f57b43ecfe8] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:07:26.868867 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-31f2f372-68d4-42d9-b663-b7af074d9a99 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:07:26.869465 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-31f2f372-68d4-42d9-b663-b7af074d9a99 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:07:26.873078 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-31f2f372-68d4-42d9-b663-b7af074d9a99 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:07:26.873628 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-31f2f372-68d4-42d9-b663-b7af074d9a99 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:07:26.888128 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.wsgi [None req-31f2f372-68d4-42d9-b663-b7af074d9a99 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] HTTP exception thrown: Instance aa81794d-bc81-49d2-b4dc-6f57b43ecfe8 could not be found. Jun 16 23:07:26.890134 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-31f2f372-68d4-42d9-b663-b7af074d9a99 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Request method failure captured: Jun 16 23:07:26.890134 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: request: GET /compute/v2.1/servers/aa81794d-bc81-49d2-b4dc-6f57b43ecfe8 HTTP/1.1 Jun 16 23:07:26.890134 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Accept: application/json Jun 16 23:07:26.890134 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Accept-Encoding: identity Jun 16 23:07:26.890134 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Connection: close Jun 16 23:07:26.890134 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Content-Length: 0 Jun 16 23:07:26.890134 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Content-Type: application/json Jun 16 23:07:26.890134 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Host: 10.222.0.17 Jun 16 23:07:26.890134 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Openstack-System-Scope: None Jun 16 23:07:26.890134 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: User-Agent: python-urllib3/1.26.9 Jun 16 23:07:26.890134 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Auth-Token: gAAAAABiq7ZXV9bp0X88ke7LpWtUCJjSYWk810MN9epqGnMR6OWYvDMOm_3rYP9wClsEPS2G-VVFaN5E8kBvf9wi7aYAYSo2Qalzy1E1kvL94T-pCvU0gyOSRkbSuK5QMm_uJ7MXPw_A_M0RQI56UidXczP0P35XsUrWWe6qw8s9jvU6wPZ1Q4w Jun 16 23:07:26.890134 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Domain-Id: None Jun 16 23:07:26.890134 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Domain-Name: None Jun 16 23:07:26.890134 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Identity-Status: Confirmed Jun 16 23:07:26.890134 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Is-Admin-Project: True Jun 16 23:07:26.890134 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Project-Domain-Id: default Jun 16 23:07:26.890134 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Project-Domain-Name: Default Jun 16 23:07:26.890134 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Project-Id: b30b90ec4d5e45468a4fa0fb98e46393 Jun 16 23:07:26.890134 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Project-Name: tempest-TestShelveInstance-1135275094 Jun 16 23:07:26.890134 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Role: member,reader Jun 16 23:07:26.890134 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Roles: member,reader Jun 16 23:07:26.891521 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/b30b90ec4d5e45468a4fa0fb98e46393"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_b30b90ec4d5e45468a4fa0fb98e46393"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b30b90ec4d5e45468a4fa0fb98e46393"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b30b90ec4d5e45468a4fa0fb98e46393"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Jun 16 23:07:26.891521 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Tenant: tempest-TestShelveInstance-1135275094 Jun 16 23:07:26.891521 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Tenant-Id: b30b90ec4d5e45468a4fa0fb98e46393 Jun 16 23:07:26.891521 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Tenant-Name: tempest-TestShelveInstance-1135275094 Jun 16 23:07:26.891521 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-User: tempest-TestShelveInstance-1135275094-project Jun 16 23:07:26.891521 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-User-Domain-Id: default Jun 16 23:07:26.891521 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-User-Domain-Name: Default Jun 16 23:07:26.891521 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-User-Id: 01dd0e5661f44d05a01d7a5e82dbadf3 Jun 16 23:07:26.891521 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-User-Name: tempest-TestShelveInstance-1135275094-project Jun 16 23:07:26.891521 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: method: > Jun 16 23:07:26.891521 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: exception: Instance aa81794d-bc81-49d2-b4dc-6f57b43ecfe8 could not be found. Jun 16 23:07:26.891521 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: action_args: {'id': 'aa81794d-bc81-49d2-b4dc-6f57b43ecfe8'} Jun 16 23:07:26.892304 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 23:07:26.892304 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 23:07:26.892304 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 23:07:26.892304 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 23:07:26.892304 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 23:07:26.892304 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 23:07:26.892304 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 23:07:26.892304 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 23:07:26.892304 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 23:07:26.892304 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 23:07:26.892304 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa81794d-bc81-49d2-b4dc-6f57b43ecfe8 could not be found. Jun 16 23:07:26.892304 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Jun 16 23:07:26.892304 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 23:07:26.892304 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Jun 16 23:07:26.892304 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 23:07:26.892304 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 23:07:26.892304 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 23:07:26.892304 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 23:07:26.892304 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 23:07:26.892304 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 23:07:26.893470 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 23:07:26.893470 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 23:07:26.893470 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 23:07:26.893470 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 23:07:26.893470 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 23:07:26.893470 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 23:07:26.893470 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 23:07:26.893470 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa81794d-bc81-49d2-b4dc-6f57b43ecfe8 could not be found. Jun 16 23:07:26.893470 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Jun 16 23:07:26.893470 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 23:07:26.893470 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Jun 16 23:07:26.893470 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 23:07:26.893470 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 23:07:26.893470 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 23:07:26.893470 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 23:07:26.893470 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 23:07:26.893470 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa81794d-bc81-49d2-b4dc-6f57b43ecfe8 could not be found. Jun 16 23:07:26.893470 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Jun 16 23:07:26.895863 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-31f2f372-68d4-42d9-b663-b7af074d9a99 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Returning 404 to user: Instance aa81794d-bc81-49d2-b4dc-6f57b43ecfe8 could not be found. {{(pid=117562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 23:07:26.896817 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-31f2f372-68d4-42d9-b663-b7af074d9a99 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] 10.222.0.17 "GET /compute/v2.1/servers/aa81794d-bc81-49d2-b4dc-6f57b43ecfe8" status: 404 len: 111 microversion: 2.1 time: 0.040828 Jun 16 23:07:26.897637 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 468/921] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:07:26 2022] GET /compute/v2.1/servers/aa81794d-bc81-49d2-b4dc-6f57b43ecfe8 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 23:07:27.180905 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-23eddd86-8515-4fb2-bb38-51e224fad5c7 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] Calling method '.version_select at 0x7f53137bdf70>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:07:27.201968 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-23eddd86-8515-4fb2-bb38-51e224fad5c7 tempest-TestShelveInstance-1135275094 tempest-TestShelveInstance-1135275094-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-815840424" status: 202 len: 0 microversion: 2.1 time: 0.024831 Jun 16 23:07:27.203016 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 454/922] 10.222.0.17 () {58 vars in 1250 bytes} [Thu Jun 16 23:07:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-815840424 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 23:07:27.418337 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-e04f45f2-9cf8-403f-9b9e-5196337aaaa5 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:07:27.420227 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-e04f45f2-9cf8-403f-9b9e-5196337aaaa5 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] [instance: 07404710-1539-46ee-b4ff-2ef30af07f8e] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:07:27.433718 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-e04f45f2-9cf8-403f-9b9e-5196337aaaa5 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:07:27.434522 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-e04f45f2-9cf8-403f-9b9e-5196337aaaa5 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:07:27.435501 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-e04f45f2-9cf8-403f-9b9e-5196337aaaa5 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:07:27.436100 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-e04f45f2-9cf8-403f-9b9e-5196337aaaa5 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:07:27.484981 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-e04f45f2-9cf8-403f-9b9e-5196337aaaa5 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] 10.222.0.17 "GET /compute/v2.1/servers/07404710-1539-46ee-b4ff-2ef30af07f8e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.071310 Jun 16 23:07:27.486356 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 469/923] 10.222.0.17 () {58 vars in 1301 bytes} [Thu Jun 16 23:07:27 2022] GET /compute/v2.1/servers/07404710-1539-46ee-b4ff-2ef30af07f8e/os-volume_attachments => generated 25 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 23:07:27.553111 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-e7d4a223-a19f-4e39-9858-db01be2b1476 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:07:27.554258 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-e7d4a223-a19f-4e39-9858-db01be2b1476 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] [instance: 07404710-1539-46ee-b4ff-2ef30af07f8e] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:07:27.561397 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-e7d4a223-a19f-4e39-9858-db01be2b1476 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:07:27.562132 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-e7d4a223-a19f-4e39-9858-db01be2b1476 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:07:27.563115 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-e7d4a223-a19f-4e39-9858-db01be2b1476 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:07:27.563711 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-e7d4a223-a19f-4e39-9858-db01be2b1476 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:07:27.603161 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-e7d4a223-a19f-4e39-9858-db01be2b1476 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] [instance: 07404710-1539-46ee-b4ff-2ef30af07f8e] Going to try to terminate instance {{(pid=117563) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 23:07:27.683518 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG dbcounter [-] [117563] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=4,nova_cell1:INSERT=4 {{(pid=117563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 23:07:27.734902 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-e7d4a223-a19f-4e39-9858-db01be2b1476 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] 10.222.0.17 "DELETE /compute/v2.1/servers/07404710-1539-46ee-b4ff-2ef30af07f8e" status: 204 len: 0 microversion: 2.1 time: 0.184771 Jun 16 23:07:27.738874 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 455/924] 10.222.0.17 () {58 vars in 1238 bytes} [Thu Jun 16 23:07:27 2022] DELETE /compute/v2.1/servers/07404710-1539-46ee-b4ff-2ef30af07f8e => generated 0 bytes in 189 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 23:07:27.748078 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-54777332-f092-4d0a-9efa-8485a3684548 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:07:27.750203 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-54777332-f092-4d0a-9efa-8485a3684548 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] [instance: 07404710-1539-46ee-b4ff-2ef30af07f8e] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:07:27.757435 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-54777332-f092-4d0a-9efa-8485a3684548 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:07:27.758100 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-54777332-f092-4d0a-9efa-8485a3684548 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:07:27.758902 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-54777332-f092-4d0a-9efa-8485a3684548 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:07:27.759495 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-54777332-f092-4d0a-9efa-8485a3684548 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:07:27.811414 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-143ed81d-222e-4232-b492-e7a1f9b24b6b tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:07:27.812694 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-143ed81d-222e-4232-b492-e7a1f9b24b6b tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] [instance: b7619c39-737f-440b-b676-8e920380d6c6] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:07:27.826170 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-143ed81d-222e-4232-b492-e7a1f9b24b6b tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:07:27.827275 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-143ed81d-222e-4232-b492-e7a1f9b24b6b tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:07:27.828303 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-143ed81d-222e-4232-b492-e7a1f9b24b6b tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:07:27.829993 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-143ed81d-222e-4232-b492-e7a1f9b24b6b tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:07:27.869764 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-143ed81d-222e-4232-b492-e7a1f9b24b6b tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] 10.222.0.17 "GET /compute/v2.1/servers/b7619c39-737f-440b-b676-8e920380d6c6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.063581 Jun 16 23:07:27.875618 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 456/925] 10.222.0.17 () {58 vars in 1301 bytes} [Thu Jun 16 23:07:27 2022] GET /compute/v2.1/servers/b7619c39-737f-440b-b676-8e920380d6c6/os-volume_attachments => generated 25 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 23:07:27.989115 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-d623b58d-88ca-4db4-be3e-c2dcbc8b1e2b tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:07:27.990391 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-d623b58d-88ca-4db4-be3e-c2dcbc8b1e2b tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] [instance: b7619c39-737f-440b-b676-8e920380d6c6] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:07:27.996611 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-d623b58d-88ca-4db4-be3e-c2dcbc8b1e2b tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:07:27.997371 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-d623b58d-88ca-4db4-be3e-c2dcbc8b1e2b tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:07:27.998665 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-d623b58d-88ca-4db4-be3e-c2dcbc8b1e2b tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:07:27.999292 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-d623b58d-88ca-4db4-be3e-c2dcbc8b1e2b tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:07:28.031709 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-d623b58d-88ca-4db4-be3e-c2dcbc8b1e2b tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] 10.222.0.17 "GET /compute/v2.1/servers/b7619c39-737f-440b-b676-8e920380d6c6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047030 Jun 16 23:07:28.032639 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 457/926] 10.222.0.17 () {58 vars in 1301 bytes} [Thu Jun 16 23:07:27 2022] GET /compute/v2.1/servers/b7619c39-737f-440b-b676-8e920380d6c6/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 23:07:28.089792 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-54777332-f092-4d0a-9efa-8485a3684548 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3a2d16133b4af8a208682de8a7d111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0526c12e8bc947209e24daf5ddfad7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:07:28.105295 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-d4116296-7243-4c64-b06d-2933e75950d4 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:07:28.107027 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-d4116296-7243-4c64-b06d-2933e75950d4 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] [instance: b7619c39-737f-440b-b676-8e920380d6c6] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:07:28.117684 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-54777332-f092-4d0a-9efa-8485a3684548 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] 10.222.0.17 "GET /compute/v2.1/servers/07404710-1539-46ee-b4ff-2ef30af07f8e" status: 200 len: 1680 microversion: 2.1 time: 0.374948 Jun 16 23:07:28.118249 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 470/927] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:07:27 2022] GET /compute/v2.1/servers/07404710-1539-46ee-b4ff-2ef30af07f8e => generated 1680 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 23:07:28.130071 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-d4116296-7243-4c64-b06d-2933e75950d4 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:07:28.130794 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-d4116296-7243-4c64-b06d-2933e75950d4 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:07:28.131764 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-d4116296-7243-4c64-b06d-2933e75950d4 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:07:28.132357 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-d4116296-7243-4c64-b06d-2933e75950d4 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:07:28.158844 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-d4116296-7243-4c64-b06d-2933e75950d4 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] [instance: b7619c39-737f-440b-b676-8e920380d6c6] Going to try to terminate instance {{(pid=117563) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 23:07:28.270889 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-d4116296-7243-4c64-b06d-2933e75950d4 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] 10.222.0.17 "DELETE /compute/v2.1/servers/b7619c39-737f-440b-b676-8e920380d6c6" status: 204 len: 0 microversion: 2.1 time: 0.169026 Jun 16 23:07:28.271927 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 458/928] 10.222.0.17 () {58 vars in 1238 bytes} [Thu Jun 16 23:07:28 2022] DELETE /compute/v2.1/servers/b7619c39-737f-440b-b676-8e920380d6c6 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 16 23:07:28.282756 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-29a7a1d9-42bc-4c44-af54-f9847a475e58 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:07:28.284555 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-29a7a1d9-42bc-4c44-af54-f9847a475e58 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] [instance: b7619c39-737f-440b-b676-8e920380d6c6] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:07:28.295450 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-29a7a1d9-42bc-4c44-af54-f9847a475e58 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:07:28.296162 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-29a7a1d9-42bc-4c44-af54-f9847a475e58 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:07:28.297136 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-29a7a1d9-42bc-4c44-af54-f9847a475e58 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:07:28.298762 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-29a7a1d9-42bc-4c44-af54-f9847a475e58 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:07:28.580248 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-29a7a1d9-42bc-4c44-af54-f9847a475e58 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a993f5d14b64fccad723abecfcadf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b1be8431b0434d8bd6abca293127d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:07:28.592101 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-29a7a1d9-42bc-4c44-af54-f9847a475e58 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] 10.222.0.17 "GET /compute/v2.1/servers/b7619c39-737f-440b-b676-8e920380d6c6" status: 200 len: 1672 microversion: 2.1 time: 0.316077 Jun 16 23:07:28.606902 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 471/929] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:07:28 2022] GET /compute/v2.1/servers/b7619c39-737f-440b-b676-8e920380d6c6 => generated 1672 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:07:29.147858 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-61269d63-ef1b-45da-84a9-62547ba09201 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:07:29.149367 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-61269d63-ef1b-45da-84a9-62547ba09201 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] [instance: 07404710-1539-46ee-b4ff-2ef30af07f8e] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:07:29.169633 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-61269d63-ef1b-45da-84a9-62547ba09201 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:07:29.172730 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-61269d63-ef1b-45da-84a9-62547ba09201 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:07:29.174670 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-61269d63-ef1b-45da-84a9-62547ba09201 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:07:29.175631 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-61269d63-ef1b-45da-84a9-62547ba09201 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:07:29.467217 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-61269d63-ef1b-45da-84a9-62547ba09201 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3a2d16133b4af8a208682de8a7d111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0526c12e8bc947209e24daf5ddfad7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:07:29.478496 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-61269d63-ef1b-45da-84a9-62547ba09201 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] 10.222.0.17 "GET /compute/v2.1/servers/07404710-1539-46ee-b4ff-2ef30af07f8e" status: 200 len: 1680 microversion: 2.1 time: 0.346255 Jun 16 23:07:29.479357 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 459/930] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:07:29 2022] GET /compute/v2.1/servers/07404710-1539-46ee-b4ff-2ef30af07f8e => generated 1680 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:07:29.614050 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-889ae282-26ec-41da-8b17-fa126a6beefb tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:07:29.615447 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-889ae282-26ec-41da-8b17-fa126a6beefb tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] [instance: b7619c39-737f-440b-b676-8e920380d6c6] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:07:29.625360 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-889ae282-26ec-41da-8b17-fa126a6beefb tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:07:29.626087 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-889ae282-26ec-41da-8b17-fa126a6beefb tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:07:29.627160 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-889ae282-26ec-41da-8b17-fa126a6beefb tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:07:29.628568 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-889ae282-26ec-41da-8b17-fa126a6beefb tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:07:29.815166 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-889ae282-26ec-41da-8b17-fa126a6beefb tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a993f5d14b64fccad723abecfcadf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b1be8431b0434d8bd6abca293127d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:07:29.823433 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-889ae282-26ec-41da-8b17-fa126a6beefb tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] 10.222.0.17 "GET /compute/v2.1/servers/b7619c39-737f-440b-b676-8e920380d6c6" status: 200 len: 1672 microversion: 2.1 time: 0.213361 Jun 16 23:07:29.826287 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 472/931] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:07:29 2022] GET /compute/v2.1/servers/b7619c39-737f-440b-b676-8e920380d6c6 => generated 1672 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:07:30.496848 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-ee683989-9d63-4257-811c-d45966312cf6 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:07:30.499129 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-ee683989-9d63-4257-811c-d45966312cf6 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] [instance: 07404710-1539-46ee-b4ff-2ef30af07f8e] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:07:30.506775 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-ee683989-9d63-4257-811c-d45966312cf6 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:07:30.507619 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-ee683989-9d63-4257-811c-d45966312cf6 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:07:30.508899 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-ee683989-9d63-4257-811c-d45966312cf6 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:07:30.509578 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-ee683989-9d63-4257-811c-d45966312cf6 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:07:30.714624 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-ee683989-9d63-4257-811c-d45966312cf6 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3a2d16133b4af8a208682de8a7d111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0526c12e8bc947209e24daf5ddfad7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:07:30.726138 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-ee683989-9d63-4257-811c-d45966312cf6 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] 10.222.0.17 "GET /compute/v2.1/servers/07404710-1539-46ee-b4ff-2ef30af07f8e" status: 200 len: 1680 microversion: 2.1 time: 0.233367 Jun 16 23:07:30.740464 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 460/932] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:07:30 2022] GET /compute/v2.1/servers/07404710-1539-46ee-b4ff-2ef30af07f8e => generated 1680 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:07:30.844964 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-3dc00475-d4fc-45c9-a73c-c66f82ff2159 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:07:30.845756 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-3dc00475-d4fc-45c9-a73c-c66f82ff2159 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] [instance: b7619c39-737f-440b-b676-8e920380d6c6] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:07:30.852209 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-3dc00475-d4fc-45c9-a73c-c66f82ff2159 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:07:30.852921 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-3dc00475-d4fc-45c9-a73c-c66f82ff2159 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:07:30.853923 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-3dc00475-d4fc-45c9-a73c-c66f82ff2159 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:07:30.854720 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-3dc00475-d4fc-45c9-a73c-c66f82ff2159 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:07:31.172808 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-3dc00475-d4fc-45c9-a73c-c66f82ff2159 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a993f5d14b64fccad723abecfcadf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b1be8431b0434d8bd6abca293127d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:07:31.186730 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-3dc00475-d4fc-45c9-a73c-c66f82ff2159 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] 10.222.0.17 "GET /compute/v2.1/servers/b7619c39-737f-440b-b676-8e920380d6c6" status: 200 len: 1672 microversion: 2.1 time: 0.347271 Jun 16 23:07:31.190321 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 473/933] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:07:30 2022] GET /compute/v2.1/servers/b7619c39-737f-440b-b676-8e920380d6c6 => generated 1672 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:07:31.755593 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-2c63a888-05e4-4d64-88a2-4cb4f012a2a2 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:07:31.756353 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-2c63a888-05e4-4d64-88a2-4cb4f012a2a2 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] [instance: 07404710-1539-46ee-b4ff-2ef30af07f8e] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:07:31.781853 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-2c63a888-05e4-4d64-88a2-4cb4f012a2a2 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:07:31.782573 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-2c63a888-05e4-4d64-88a2-4cb4f012a2a2 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:07:31.785235 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-2c63a888-05e4-4d64-88a2-4cb4f012a2a2 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:07:31.789313 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-2c63a888-05e4-4d64-88a2-4cb4f012a2a2 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:07:32.211196 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-cf73ad1c-4a26-43d4-8678-871da78bb2bb tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:07:32.212029 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-cf73ad1c-4a26-43d4-8678-871da78bb2bb tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] [instance: b7619c39-737f-440b-b676-8e920380d6c6] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:07:32.226506 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-cf73ad1c-4a26-43d4-8678-871da78bb2bb tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:07:32.228555 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-cf73ad1c-4a26-43d4-8678-871da78bb2bb tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:07:32.230055 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-cf73ad1c-4a26-43d4-8678-871da78bb2bb tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:07:32.232682 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-cf73ad1c-4a26-43d4-8678-871da78bb2bb tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:07:32.412392 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-cf73ad1c-4a26-43d4-8678-871da78bb2bb tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a993f5d14b64fccad723abecfcadf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b1be8431b0434d8bd6abca293127d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:07:32.420450 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-cf73ad1c-4a26-43d4-8678-871da78bb2bb tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] 10.222.0.17 "GET /compute/v2.1/servers/b7619c39-737f-440b-b676-8e920380d6c6" status: 200 len: 1605 microversion: 2.1 time: 0.215518 Jun 16 23:07:32.433281 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 474/934] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:07:32 2022] GET /compute/v2.1/servers/b7619c39-737f-440b-b676-8e920380d6c6 => generated 1605 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:07:32.457782 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-2c63a888-05e4-4d64-88a2-4cb4f012a2a2 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3a2d16133b4af8a208682de8a7d111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0526c12e8bc947209e24daf5ddfad7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:07:32.465757 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-2c63a888-05e4-4d64-88a2-4cb4f012a2a2 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] 10.222.0.17 "GET /compute/v2.1/servers/07404710-1539-46ee-b4ff-2ef30af07f8e" status: 200 len: 1680 microversion: 2.1 time: 0.716183 Jun 16 23:07:32.466328 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 461/935] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:07:31 2022] GET /compute/v2.1/servers/07404710-1539-46ee-b4ff-2ef30af07f8e => generated 1680 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:07:32.729983 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [req-b7a3f10e-dc89-4ddd-ae74-d3bf868f169e req-7cf6cf8b-209f-4760-a506-32184777783a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7619c39-737f-440b-b676-8e920380d6c6", "name": "network-vif-deleted", "tag": "f3bd5725-2a88-4068-b338-b761ad56e180"}]} {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 23:07:32.756884 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [req-b7a3f10e-dc89-4ddd-ae74-d3bf868f169e req-7cf6cf8b-209f-4760-a506-32184777783a service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:07:32.759424 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [req-b7a3f10e-dc89-4ddd-ae74-d3bf868f169e req-7cf6cf8b-209f-4760-a506-32184777783a service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:07:32.804508 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.compute.server_external_events [req-b7a3f10e-dc89-4ddd-ae74-d3bf868f169e req-7cf6cf8b-209f-4760-a506-32184777783a service nova] Creating event network-vif-deleted:f3bd5725-2a88-4068-b338-b761ad56e180 for instance b7619c39-737f-440b-b676-8e920380d6c6 on hv-cinder-84623 Jun 16 23:07:32.818358 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [req-b7a3f10e-dc89-4ddd-ae74-d3bf868f169e req-7cf6cf8b-209f-4760-a506-32184777783a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095480 Jun 16 23:07:32.822676 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 475/936] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 23:07:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 23:07:33.408974 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [req-9983dcfd-ee4b-4bb1-953d-d362056c53b7 req-4f390d03-3fa6-4fe3-8fcf-6db4deb45d50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07404710-1539-46ee-b4ff-2ef30af07f8e", "name": "network-vif-deleted", "tag": "e518f3e5-de33-40af-8a0b-72951461a47a"}]} {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 23:07:33.423822 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-9983dcfd-ee4b-4bb1-953d-d362056c53b7 req-4f390d03-3fa6-4fe3-8fcf-6db4deb45d50 service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:07:33.426354 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-9983dcfd-ee4b-4bb1-953d-d362056c53b7 req-4f390d03-3fa6-4fe3-8fcf-6db4deb45d50 service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:07:33.444413 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-6369a3c9-1abc-46f0-8846-bc6f13534bd9 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:07:33.445730 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-6369a3c9-1abc-46f0-8846-bc6f13534bd9 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] [instance: b7619c39-737f-440b-b676-8e920380d6c6] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:07:33.460262 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.compute.server_external_events [req-9983dcfd-ee4b-4bb1-953d-d362056c53b7 req-4f390d03-3fa6-4fe3-8fcf-6db4deb45d50 service nova] Creating event network-vif-deleted:e518f3e5-de33-40af-8a0b-72951461a47a for instance 07404710-1539-46ee-b4ff-2ef30af07f8e on hv-cinder-84623 Jun 16 23:07:33.461343 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-6369a3c9-1abc-46f0-8846-bc6f13534bd9 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:07:33.462020 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-6369a3c9-1abc-46f0-8846-bc6f13534bd9 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:07:33.467527 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-6369a3c9-1abc-46f0-8846-bc6f13534bd9 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:07:33.468299 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-6369a3c9-1abc-46f0-8846-bc6f13534bd9 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:07:33.480662 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [req-9983dcfd-ee4b-4bb1-953d-d362056c53b7 req-4f390d03-3fa6-4fe3-8fcf-6db4deb45d50 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075217 Jun 16 23:07:33.481545 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 462/937] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 23:07:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 23:07:33.503150 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-1286e7e2-1204-417c-a189-b8ae12bd61fd tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:07:33.505695 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-1286e7e2-1204-417c-a189-b8ae12bd61fd tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] [instance: 07404710-1539-46ee-b4ff-2ef30af07f8e] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:07:33.530190 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-1286e7e2-1204-417c-a189-b8ae12bd61fd tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:07:33.530657 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-1286e7e2-1204-417c-a189-b8ae12bd61fd tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:07:33.537615 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-1286e7e2-1204-417c-a189-b8ae12bd61fd tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:07:33.538140 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-1286e7e2-1204-417c-a189-b8ae12bd61fd tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:07:33.572793 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-6369a3c9-1abc-46f0-8846-bc6f13534bd9 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:07:33.577191 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-6369a3c9-1abc-46f0-8846-bc6f13534bd9 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:07:33.577883 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.objects.instance [None req-6369a3c9-1abc-46f0-8846-bc6f13534bd9 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lazy-loading 'fault' on Instance uuid b7619c39-737f-440b-b676-8e920380d6c6 {{(pid=117562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 23:07:33.706026 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-6369a3c9-1abc-46f0-8846-bc6f13534bd9 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a993f5d14b64fccad723abecfcadf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b1be8431b0434d8bd6abca293127d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:07:33.714229 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-6369a3c9-1abc-46f0-8846-bc6f13534bd9 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] 10.222.0.17 "GET /compute/v2.1/servers/b7619c39-737f-440b-b676-8e920380d6c6" status: 200 len: 1328 microversion: 2.1 time: 0.276374 Jun 16 23:07:33.719250 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 476/938] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:07:33 2022] GET /compute/v2.1/servers/b7619c39-737f-440b-b676-8e920380d6c6 => generated 1328 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 23:07:33.754115 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-1286e7e2-1204-417c-a189-b8ae12bd61fd tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3a2d16133b4af8a208682de8a7d111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0526c12e8bc947209e24daf5ddfad7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:07:33.765448 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-1286e7e2-1204-417c-a189-b8ae12bd61fd tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] 10.222.0.17 "GET /compute/v2.1/servers/07404710-1539-46ee-b4ff-2ef30af07f8e" status: 200 len: 1326 microversion: 2.1 time: 0.280690 Jun 16 23:07:33.775323 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 463/939] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:07:33 2022] GET /compute/v2.1/servers/07404710-1539-46ee-b4ff-2ef30af07f8e => generated 1326 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:07:34.737643 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-e708af3e-d8b2-47f6-b3ca-cbe3c585a513 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:07:34.738260 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-e708af3e-d8b2-47f6-b3ca-cbe3c585a513 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] [instance: b7619c39-737f-440b-b676-8e920380d6c6] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:07:34.745383 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-e708af3e-d8b2-47f6-b3ca-cbe3c585a513 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:07:34.746698 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-e708af3e-d8b2-47f6-b3ca-cbe3c585a513 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:07:34.747704 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-e708af3e-d8b2-47f6-b3ca-cbe3c585a513 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:07:34.748328 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-e708af3e-d8b2-47f6-b3ca-cbe3c585a513 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:07:34.757147 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG dbcounter [-] [117562] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=117562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 23:07:34.774446 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.wsgi [None req-e708af3e-d8b2-47f6-b3ca-cbe3c585a513 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] HTTP exception thrown: Instance b7619c39-737f-440b-b676-8e920380d6c6 could not be found. Jun 16 23:07:34.776540 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-e708af3e-d8b2-47f6-b3ca-cbe3c585a513 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Request method failure captured: Jun 16 23:07:34.776540 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: request: GET /compute/v2.1/servers/b7619c39-737f-440b-b676-8e920380d6c6 HTTP/1.1 Jun 16 23:07:34.776540 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Accept: application/json Jun 16 23:07:34.776540 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Accept-Encoding: identity Jun 16 23:07:34.776540 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Connection: close Jun 16 23:07:34.776540 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Content-Length: 0 Jun 16 23:07:34.776540 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Content-Type: application/json Jun 16 23:07:34.776540 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Host: 10.222.0.17 Jun 16 23:07:34.776540 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Openstack-System-Scope: None Jun 16 23:07:34.776540 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: User-Agent: python-urllib3/1.26.9 Jun 16 23:07:34.776540 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Auth-Token: gAAAAABiq7Ybkk4rah_fv4iIT3idoyxagEJSApfLNzYq7Fra8s6MuOetujUSvchI7nZZPa3uftYuuLfFRK893xYPK0M7YIPcU59Mp2UTI5ytwc6UmxRGSLxfQa_itibxYb7ELKNBXf5r_xsHXxmPbxfkW6tU28wgKVjK4ck02G_3-DW1dXLlatw Jun 16 23:07:34.776540 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Domain-Id: None Jun 16 23:07:34.776540 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Domain-Name: None Jun 16 23:07:34.776540 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Identity-Status: Confirmed Jun 16 23:07:34.776540 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Is-Admin-Project: True Jun 16 23:07:34.776540 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Project-Domain-Id: default Jun 16 23:07:34.776540 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Project-Domain-Name: Default Jun 16 23:07:34.776540 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Project-Id: f3b1be8431b0434d8bd6abca293127d5 Jun 16 23:07:34.776540 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Project-Name: tempest-AttachVolumeTestJSON-1621945621 Jun 16 23:07:34.776540 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Role: member,reader Jun 16 23:07:34.776540 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Roles: member,reader Jun 16 23:07:34.778484 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/f3b1be8431b0434d8bd6abca293127d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_f3b1be8431b0434d8bd6abca293127d5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f3b1be8431b0434d8bd6abca293127d5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f3b1be8431b0434d8bd6abca293127d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Jun 16 23:07:34.778484 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Tenant: tempest-AttachVolumeTestJSON-1621945621 Jun 16 23:07:34.778484 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Tenant-Id: f3b1be8431b0434d8bd6abca293127d5 Jun 16 23:07:34.778484 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1621945621 Jun 16 23:07:34.778484 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-User: tempest-AttachVolumeTestJSON-1621945621-project Jun 16 23:07:34.778484 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-User-Domain-Id: default Jun 16 23:07:34.778484 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-User-Domain-Name: Default Jun 16 23:07:34.778484 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-User-Id: 6a993f5d14b64fccad723abecfcadf90 Jun 16 23:07:34.778484 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-User-Name: tempest-AttachVolumeTestJSON-1621945621-project Jun 16 23:07:34.778484 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: method: > Jun 16 23:07:34.778484 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: exception: Instance b7619c39-737f-440b-b676-8e920380d6c6 could not be found. Jun 16 23:07:34.778484 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: action_args: {'id': 'b7619c39-737f-440b-b676-8e920380d6c6'} Jun 16 23:07:34.779303 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 23:07:34.779303 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 23:07:34.779303 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 23:07:34.779303 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 23:07:34.779303 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 23:07:34.779303 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 23:07:34.779303 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 23:07:34.779303 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 23:07:34.779303 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 23:07:34.779303 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 23:07:34.779303 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7619c39-737f-440b-b676-8e920380d6c6 could not be found. Jun 16 23:07:34.779303 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Jun 16 23:07:34.779303 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 23:07:34.779303 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Jun 16 23:07:34.779303 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 23:07:34.779303 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 23:07:34.779303 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 23:07:34.779303 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 23:07:34.779303 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 23:07:34.779303 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 23:07:34.780773 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 23:07:34.780773 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 23:07:34.780773 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 23:07:34.780773 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 23:07:34.780773 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 23:07:34.780773 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 23:07:34.780773 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 23:07:34.780773 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7619c39-737f-440b-b676-8e920380d6c6 could not be found. Jun 16 23:07:34.780773 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Jun 16 23:07:34.780773 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 23:07:34.780773 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Jun 16 23:07:34.780773 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 23:07:34.780773 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 23:07:34.780773 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 23:07:34.780773 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 23:07:34.780773 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 23:07:34.780773 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7619c39-737f-440b-b676-8e920380d6c6 could not be found. Jun 16 23:07:34.780773 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Jun 16 23:07:34.782164 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-f862488f-e290-48c5-82da-b5604986e122 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:07:34.783276 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-f862488f-e290-48c5-82da-b5604986e122 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] [instance: 07404710-1539-46ee-b4ff-2ef30af07f8e] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:07:34.784339 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-e708af3e-d8b2-47f6-b3ca-cbe3c585a513 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Returning 404 to user: Instance b7619c39-737f-440b-b676-8e920380d6c6 could not be found. {{(pid=117562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 23:07:34.785690 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-e708af3e-d8b2-47f6-b3ca-cbe3c585a513 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] 10.222.0.17 "GET /compute/v2.1/servers/b7619c39-737f-440b-b676-8e920380d6c6" status: 404 len: 111 microversion: 2.1 time: 0.051999 Jun 16 23:07:34.785915 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG dbcounter [-] [117563] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=117563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 23:07:34.786696 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 477/940] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:07:34 2022] GET /compute/v2.1/servers/b7619c39-737f-440b-b676-8e920380d6c6 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 23:07:34.795171 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-fb6f6869-8981-402a-a671-66d5e33d4ce0 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Calling method '.version_select at 0x7f5313e1f430>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:07:34.800099 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-f862488f-e290-48c5-82da-b5604986e122 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:07:34.800733 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-f862488f-e290-48c5-82da-b5604986e122 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:07:34.801535 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-f862488f-e290-48c5-82da-b5604986e122 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:07:34.801974 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-f862488f-e290-48c5-82da-b5604986e122 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:07:34.836753 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-fb6f6869-8981-402a-a671-66d5e33d4ce0 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1672104557" status: 202 len: 0 microversion: 2.1 time: 0.045342 Jun 16 23:07:34.838028 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 478/941] 10.222.0.17 () {58 vars in 1220 bytes} [Thu Jun 16 23:07:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1672104557 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 23:07:34.874684 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.wsgi [None req-f862488f-e290-48c5-82da-b5604986e122 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] HTTP exception thrown: Instance 07404710-1539-46ee-b4ff-2ef30af07f8e could not be found. Jun 16 23:07:34.876362 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-f862488f-e290-48c5-82da-b5604986e122 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Request method failure captured: Jun 16 23:07:34.876362 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: request: GET /compute/v2.1/servers/07404710-1539-46ee-b4ff-2ef30af07f8e HTTP/1.1 Jun 16 23:07:34.876362 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Accept: application/json Jun 16 23:07:34.876362 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Accept-Encoding: identity Jun 16 23:07:34.876362 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Connection: close Jun 16 23:07:34.876362 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Content-Length: 0 Jun 16 23:07:34.876362 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Content-Type: application/json Jun 16 23:07:34.876362 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Host: 10.222.0.17 Jun 16 23:07:34.876362 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Openstack-System-Scope: None Jun 16 23:07:34.876362 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: User-Agent: python-urllib3/1.26.9 Jun 16 23:07:34.876362 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Auth-Token: gAAAAABiq7YeRQnlz8l2GSIF0VOET6Y1W8yBB5oz1cYYpYFcfT7cYY0kIvo4O2qRVrDvagXVbkghr-k-KGb8GCGo_mbQOK1vAXciruDemULKCP_QAI9xPZafRW81TxgAIAvJEx6CPJUGbCIq4SyYsx25OB1SZXBFh8aRZWpbG6CQ65KEZvQlgIo Jun 16 23:07:34.876362 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Domain-Id: None Jun 16 23:07:34.876362 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Domain-Name: None Jun 16 23:07:34.876362 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Identity-Status: Confirmed Jun 16 23:07:34.876362 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Is-Admin-Project: True Jun 16 23:07:34.876362 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Project-Domain-Id: default Jun 16 23:07:34.876362 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Project-Domain-Name: Default Jun 16 23:07:34.876362 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Project-Id: 0526c12e8bc947209e24daf5ddfad7be Jun 16 23:07:34.876362 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Project-Name: tempest-AttachVolumeNegativeTest-1967724585 Jun 16 23:07:34.876362 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Role: member,reader Jun 16 23:07:34.876362 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Roles: member,reader Jun 16 23:07:34.878046 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/0526c12e8bc947209e24daf5ddfad7be"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_0526c12e8bc947209e24daf5ddfad7be"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0526c12e8bc947209e24daf5ddfad7be"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0526c12e8bc947209e24daf5ddfad7be"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Jun 16 23:07:34.878046 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Tenant: tempest-AttachVolumeNegativeTest-1967724585 Jun 16 23:07:34.878046 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Tenant-Id: 0526c12e8bc947209e24daf5ddfad7be Jun 16 23:07:34.878046 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1967724585 Jun 16 23:07:34.878046 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-User: tempest-AttachVolumeNegativeTest-1967724585-project Jun 16 23:07:34.878046 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-User-Domain-Id: default Jun 16 23:07:34.878046 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-User-Domain-Name: Default Jun 16 23:07:34.878046 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-User-Id: 9e3a2d16133b4af8a208682de8a7d111 Jun 16 23:07:34.878046 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-User-Name: tempest-AttachVolumeNegativeTest-1967724585-project Jun 16 23:07:34.878046 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: method: > Jun 16 23:07:34.878046 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: exception: Instance 07404710-1539-46ee-b4ff-2ef30af07f8e could not be found. Jun 16 23:07:34.878046 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: action_args: {'id': '07404710-1539-46ee-b4ff-2ef30af07f8e'} Jun 16 23:07:34.879085 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 23:07:34.879085 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 23:07:34.879085 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 23:07:34.879085 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 23:07:34.879085 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 23:07:34.879085 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 23:07:34.879085 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 23:07:34.879085 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 23:07:34.879085 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 23:07:34.879085 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 23:07:34.879085 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 07404710-1539-46ee-b4ff-2ef30af07f8e could not be found. Jun 16 23:07:34.879085 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 16 23:07:34.879085 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 23:07:34.879085 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 16 23:07:34.879085 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 23:07:34.879085 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 23:07:34.879085 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 23:07:34.879085 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 23:07:34.879085 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 23:07:34.879085 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 23:07:34.880543 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 23:07:34.880543 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 23:07:34.880543 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 23:07:34.880543 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 23:07:34.880543 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 23:07:34.880543 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 23:07:34.880543 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 23:07:34.880543 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 07404710-1539-46ee-b4ff-2ef30af07f8e could not be found. Jun 16 23:07:34.880543 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 16 23:07:34.880543 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 23:07:34.880543 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 16 23:07:34.880543 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 23:07:34.880543 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 23:07:34.880543 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 23:07:34.880543 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 23:07:34.880543 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 23:07:34.880543 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 07404710-1539-46ee-b4ff-2ef30af07f8e could not be found. Jun 16 23:07:34.880543 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 16 23:07:34.881928 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-f862488f-e290-48c5-82da-b5604986e122 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Returning 404 to user: Instance 07404710-1539-46ee-b4ff-2ef30af07f8e could not be found. {{(pid=117563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 23:07:34.881928 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-f862488f-e290-48c5-82da-b5604986e122 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] 10.222.0.17 "GET /compute/v2.1/servers/07404710-1539-46ee-b4ff-2ef30af07f8e" status: 404 len: 111 microversion: 2.1 time: 0.099435 Jun 16 23:07:34.892164 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 464/942] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:07:34 2022] GET /compute/v2.1/servers/07404710-1539-46ee-b4ff-2ef30af07f8e => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 23:07:34.892861 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-6eaa74ec-e9ed-4d64-832e-a840fb89c24f tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Calling method '.version_select at 0x7f5313dda430>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:07:34.933638 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-6eaa74ec-e9ed-4d64-832e-a840fb89c24f tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-262034099" status: 202 len: 0 microversion: 2.1 time: 0.044519 Jun 16 23:07:34.937664 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 479/943] 10.222.0.17 () {58 vars in 1217 bytes} [Thu Jun 16 23:07:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-262034099 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 16 23:07:37.539793 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-d48103fe-f5a6-4a51-9f5c-5affbb9dd665 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:07:37.541493 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-d48103fe-f5a6-4a51-9f5c-5affbb9dd665 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] [instance: 07404710-1539-46ee-b4ff-2ef30af07f8e] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:07:37.550459 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-d48103fe-f5a6-4a51-9f5c-5affbb9dd665 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:07:37.551302 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-d48103fe-f5a6-4a51-9f5c-5affbb9dd665 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:07:37.552358 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-d48103fe-f5a6-4a51-9f5c-5affbb9dd665 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:07:37.553135 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-d48103fe-f5a6-4a51-9f5c-5affbb9dd665 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:07:37.570357 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.wsgi [None req-d48103fe-f5a6-4a51-9f5c-5affbb9dd665 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] HTTP exception thrown: Instance 07404710-1539-46ee-b4ff-2ef30af07f8e could not be found. Jun 16 23:07:37.572385 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-d48103fe-f5a6-4a51-9f5c-5affbb9dd665 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Request method failure captured: Jun 16 23:07:37.572385 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: request: DELETE /compute/v2.1/servers/07404710-1539-46ee-b4ff-2ef30af07f8e HTTP/1.1 Jun 16 23:07:37.572385 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Accept: application/json Jun 16 23:07:37.572385 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Accept-Encoding: identity Jun 16 23:07:37.572385 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Connection: close Jun 16 23:07:37.572385 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Content-Length: 0 Jun 16 23:07:37.572385 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Content-Type: application/json Jun 16 23:07:37.572385 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Host: 10.222.0.17 Jun 16 23:07:37.572385 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Openstack-System-Scope: None Jun 16 23:07:37.572385 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: User-Agent: python-urllib3/1.26.9 Jun 16 23:07:37.572385 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Auth-Token: gAAAAABiq7YeRQnlz8l2GSIF0VOET6Y1W8yBB5oz1cYYpYFcfT7cYY0kIvo4O2qRVrDvagXVbkghr-k-KGb8GCGo_mbQOK1vAXciruDemULKCP_QAI9xPZafRW81TxgAIAvJEx6CPJUGbCIq4SyYsx25OB1SZXBFh8aRZWpbG6CQ65KEZvQlgIo Jun 16 23:07:37.572385 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Domain-Id: None Jun 16 23:07:37.572385 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Domain-Name: None Jun 16 23:07:37.572385 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Identity-Status: Confirmed Jun 16 23:07:37.572385 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Is-Admin-Project: True Jun 16 23:07:37.572385 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Project-Domain-Id: default Jun 16 23:07:37.572385 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Project-Domain-Name: Default Jun 16 23:07:37.572385 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Project-Id: 0526c12e8bc947209e24daf5ddfad7be Jun 16 23:07:37.572385 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Project-Name: tempest-AttachVolumeNegativeTest-1967724585 Jun 16 23:07:37.572385 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Role: member,reader Jun 16 23:07:37.572385 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Roles: member,reader Jun 16 23:07:37.574642 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/0526c12e8bc947209e24daf5ddfad7be"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_0526c12e8bc947209e24daf5ddfad7be"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0526c12e8bc947209e24daf5ddfad7be"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0526c12e8bc947209e24daf5ddfad7be"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Jun 16 23:07:37.574642 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Tenant: tempest-AttachVolumeNegativeTest-1967724585 Jun 16 23:07:37.574642 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Tenant-Id: 0526c12e8bc947209e24daf5ddfad7be Jun 16 23:07:37.574642 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1967724585 Jun 16 23:07:37.574642 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-User: tempest-AttachVolumeNegativeTest-1967724585-project Jun 16 23:07:37.574642 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-User-Domain-Id: default Jun 16 23:07:37.574642 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-User-Domain-Name: Default Jun 16 23:07:37.574642 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-User-Id: 9e3a2d16133b4af8a208682de8a7d111 Jun 16 23:07:37.574642 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-User-Name: tempest-AttachVolumeNegativeTest-1967724585-project Jun 16 23:07:37.574642 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: method: > Jun 16 23:07:37.574642 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: exception: Instance 07404710-1539-46ee-b4ff-2ef30af07f8e could not be found. Jun 16 23:07:37.574642 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: action_args: {'id': '07404710-1539-46ee-b4ff-2ef30af07f8e'} Jun 16 23:07:37.575379 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 23:07:37.575379 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 23:07:37.575379 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 23:07:37.575379 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 23:07:37.575379 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 23:07:37.575379 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 23:07:37.575379 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 23:07:37.575379 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 23:07:37.575379 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 23:07:37.575379 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 23:07:37.575379 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 07404710-1539-46ee-b4ff-2ef30af07f8e could not be found. Jun 16 23:07:37.575379 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 16 23:07:37.575379 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 23:07:37.575379 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 16 23:07:37.575379 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 23:07:37.575379 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 23:07:37.575379 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 23:07:37.575379 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 23:07:37.575379 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 23:07:37.575379 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 23:07:37.576588 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 23:07:37.576588 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 23:07:37.576588 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 23:07:37.576588 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 23:07:37.576588 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 23:07:37.576588 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 23:07:37.576588 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 23:07:37.576588 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 23:07:37.576588 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 23:07:37.576588 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 07404710-1539-46ee-b4ff-2ef30af07f8e could not be found. Jun 16 23:07:37.576588 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 16 23:07:37.576588 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 23:07:37.576588 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 16 23:07:37.576588 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 23:07:37.576588 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 23:07:37.576588 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 23:07:37.576588 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 23:07:37.576588 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 23:07:37.576588 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 07404710-1539-46ee-b4ff-2ef30af07f8e could not be found. Jun 16 23:07:37.576588 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 16 23:07:37.579471 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-d48103fe-f5a6-4a51-9f5c-5affbb9dd665 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Returning 404 to user: Instance 07404710-1539-46ee-b4ff-2ef30af07f8e could not be found. {{(pid=117563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 23:07:37.580541 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-d48103fe-f5a6-4a51-9f5c-5affbb9dd665 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] 10.222.0.17 "DELETE /compute/v2.1/servers/07404710-1539-46ee-b4ff-2ef30af07f8e" status: 404 len: 111 microversion: 2.1 time: 0.045294 Jun 16 23:07:37.590269 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-927c01f8-29f7-4ea1-8d0a-54439852ad1c tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:07:37.591521 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-927c01f8-29f7-4ea1-8d0a-54439852ad1c tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] [instance: 07404710-1539-46ee-b4ff-2ef30af07f8e] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:07:37.595171 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 465/944] 10.222.0.17 () {58 vars in 1238 bytes} [Thu Jun 16 23:07:37 2022] DELETE /compute/v2.1/servers/07404710-1539-46ee-b4ff-2ef30af07f8e => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 23:07:37.600593 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-927c01f8-29f7-4ea1-8d0a-54439852ad1c tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:07:37.601345 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-927c01f8-29f7-4ea1-8d0a-54439852ad1c tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:07:37.602473 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-927c01f8-29f7-4ea1-8d0a-54439852ad1c tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:07:37.603261 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-927c01f8-29f7-4ea1-8d0a-54439852ad1c tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:07:37.617896 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.wsgi [None req-927c01f8-29f7-4ea1-8d0a-54439852ad1c tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] HTTP exception thrown: Instance 07404710-1539-46ee-b4ff-2ef30af07f8e could not be found. Jun 16 23:07:37.619818 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-927c01f8-29f7-4ea1-8d0a-54439852ad1c tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Request method failure captured: Jun 16 23:07:37.619818 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: request: GET /compute/v2.1/servers/07404710-1539-46ee-b4ff-2ef30af07f8e HTTP/1.1 Jun 16 23:07:37.619818 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Accept: application/json Jun 16 23:07:37.619818 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Accept-Encoding: identity Jun 16 23:07:37.619818 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Connection: close Jun 16 23:07:37.619818 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Content-Length: 0 Jun 16 23:07:37.619818 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Content-Type: application/json Jun 16 23:07:37.619818 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Host: 10.222.0.17 Jun 16 23:07:37.619818 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Openstack-System-Scope: None Jun 16 23:07:37.619818 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: User-Agent: python-urllib3/1.26.9 Jun 16 23:07:37.619818 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Auth-Token: gAAAAABiq7YeRQnlz8l2GSIF0VOET6Y1W8yBB5oz1cYYpYFcfT7cYY0kIvo4O2qRVrDvagXVbkghr-k-KGb8GCGo_mbQOK1vAXciruDemULKCP_QAI9xPZafRW81TxgAIAvJEx6CPJUGbCIq4SyYsx25OB1SZXBFh8aRZWpbG6CQ65KEZvQlgIo Jun 16 23:07:37.619818 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Domain-Id: None Jun 16 23:07:37.619818 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Domain-Name: None Jun 16 23:07:37.619818 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Identity-Status: Confirmed Jun 16 23:07:37.619818 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Is-Admin-Project: True Jun 16 23:07:37.619818 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Project-Domain-Id: default Jun 16 23:07:37.619818 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Project-Domain-Name: Default Jun 16 23:07:37.619818 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Project-Id: 0526c12e8bc947209e24daf5ddfad7be Jun 16 23:07:37.619818 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Project-Name: tempest-AttachVolumeNegativeTest-1967724585 Jun 16 23:07:37.619818 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Role: member,reader Jun 16 23:07:37.619818 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Roles: member,reader Jun 16 23:07:37.621749 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/0526c12e8bc947209e24daf5ddfad7be"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_0526c12e8bc947209e24daf5ddfad7be"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0526c12e8bc947209e24daf5ddfad7be"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0526c12e8bc947209e24daf5ddfad7be"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Jun 16 23:07:37.621749 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Tenant: tempest-AttachVolumeNegativeTest-1967724585 Jun 16 23:07:37.621749 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Tenant-Id: 0526c12e8bc947209e24daf5ddfad7be Jun 16 23:07:37.621749 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1967724585 Jun 16 23:07:37.621749 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-User: tempest-AttachVolumeNegativeTest-1967724585-project Jun 16 23:07:37.621749 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-User-Domain-Id: default Jun 16 23:07:37.621749 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-User-Domain-Name: Default Jun 16 23:07:37.621749 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-User-Id: 9e3a2d16133b4af8a208682de8a7d111 Jun 16 23:07:37.621749 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-User-Name: tempest-AttachVolumeNegativeTest-1967724585-project Jun 16 23:07:37.621749 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: method: > Jun 16 23:07:37.621749 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: exception: Instance 07404710-1539-46ee-b4ff-2ef30af07f8e could not be found. Jun 16 23:07:37.621749 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: action_args: {'id': '07404710-1539-46ee-b4ff-2ef30af07f8e'} Jun 16 23:07:37.622505 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 23:07:37.622505 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 23:07:37.622505 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 23:07:37.622505 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 23:07:37.622505 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 23:07:37.622505 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 23:07:37.622505 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 23:07:37.622505 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 23:07:37.622505 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 23:07:37.622505 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 23:07:37.622505 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 07404710-1539-46ee-b4ff-2ef30af07f8e could not be found. Jun 16 23:07:37.622505 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Jun 16 23:07:37.622505 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 23:07:37.622505 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Jun 16 23:07:37.622505 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 23:07:37.622505 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 23:07:37.622505 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 23:07:37.622505 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 23:07:37.622505 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 23:07:37.622505 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 23:07:37.624746 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 23:07:37.624746 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 23:07:37.624746 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 23:07:37.624746 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 23:07:37.624746 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 23:07:37.624746 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 23:07:37.624746 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 23:07:37.624746 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 07404710-1539-46ee-b4ff-2ef30af07f8e could not be found. Jun 16 23:07:37.624746 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Jun 16 23:07:37.624746 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 23:07:37.624746 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Jun 16 23:07:37.624746 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 23:07:37.624746 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 23:07:37.624746 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 23:07:37.624746 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 23:07:37.624746 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 23:07:37.624746 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 07404710-1539-46ee-b4ff-2ef30af07f8e could not be found. Jun 16 23:07:37.624746 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Jun 16 23:07:37.627223 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-927c01f8-29f7-4ea1-8d0a-54439852ad1c tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Returning 404 to user: Instance 07404710-1539-46ee-b4ff-2ef30af07f8e could not be found. {{(pid=117562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 23:07:37.628461 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-927c01f8-29f7-4ea1-8d0a-54439852ad1c tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] 10.222.0.17 "GET /compute/v2.1/servers/07404710-1539-46ee-b4ff-2ef30af07f8e" status: 404 len: 111 microversion: 2.1 time: 0.043027 Jun 16 23:07:37.632680 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 480/945] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:07:37 2022] GET /compute/v2.1/servers/07404710-1539-46ee-b4ff-2ef30af07f8e => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 23:07:38.370579 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-bbb5bd55-40ad-4937-8d8d-424812f3f083 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:07:38.371123 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-bbb5bd55-40ad-4937-8d8d-424812f3f083 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] [instance: b7619c39-737f-440b-b676-8e920380d6c6] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:07:38.380318 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-bbb5bd55-40ad-4937-8d8d-424812f3f083 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:07:38.381010 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-bbb5bd55-40ad-4937-8d8d-424812f3f083 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:07:38.381790 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-bbb5bd55-40ad-4937-8d8d-424812f3f083 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:07:38.382509 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-bbb5bd55-40ad-4937-8d8d-424812f3f083 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:07:38.397932 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.wsgi [None req-bbb5bd55-40ad-4937-8d8d-424812f3f083 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] HTTP exception thrown: Instance b7619c39-737f-440b-b676-8e920380d6c6 could not be found. Jun 16 23:07:38.399936 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-bbb5bd55-40ad-4937-8d8d-424812f3f083 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Request method failure captured: Jun 16 23:07:38.399936 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: request: DELETE /compute/v2.1/servers/b7619c39-737f-440b-b676-8e920380d6c6 HTTP/1.1 Jun 16 23:07:38.399936 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Accept: application/json Jun 16 23:07:38.399936 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Accept-Encoding: identity Jun 16 23:07:38.399936 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Connection: close Jun 16 23:07:38.399936 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Content-Length: 0 Jun 16 23:07:38.399936 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Content-Type: application/json Jun 16 23:07:38.399936 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Host: 10.222.0.17 Jun 16 23:07:38.399936 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Openstack-System-Scope: None Jun 16 23:07:38.399936 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: User-Agent: python-urllib3/1.26.9 Jun 16 23:07:38.399936 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Auth-Token: gAAAAABiq7Ybkk4rah_fv4iIT3idoyxagEJSApfLNzYq7Fra8s6MuOetujUSvchI7nZZPa3uftYuuLfFRK893xYPK0M7YIPcU59Mp2UTI5ytwc6UmxRGSLxfQa_itibxYb7ELKNBXf5r_xsHXxmPbxfkW6tU28wgKVjK4ck02G_3-DW1dXLlatw Jun 16 23:07:38.399936 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Domain-Id: None Jun 16 23:07:38.399936 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Domain-Name: None Jun 16 23:07:38.399936 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Identity-Status: Confirmed Jun 16 23:07:38.399936 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Is-Admin-Project: True Jun 16 23:07:38.399936 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Project-Domain-Id: default Jun 16 23:07:38.399936 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Project-Domain-Name: Default Jun 16 23:07:38.399936 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Project-Id: f3b1be8431b0434d8bd6abca293127d5 Jun 16 23:07:38.399936 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Project-Name: tempest-AttachVolumeTestJSON-1621945621 Jun 16 23:07:38.399936 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Role: member,reader Jun 16 23:07:38.399936 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Roles: member,reader Jun 16 23:07:38.401325 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/f3b1be8431b0434d8bd6abca293127d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_f3b1be8431b0434d8bd6abca293127d5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f3b1be8431b0434d8bd6abca293127d5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f3b1be8431b0434d8bd6abca293127d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Jun 16 23:07:38.401325 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Tenant: tempest-AttachVolumeTestJSON-1621945621 Jun 16 23:07:38.401325 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Tenant-Id: f3b1be8431b0434d8bd6abca293127d5 Jun 16 23:07:38.401325 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1621945621 Jun 16 23:07:38.401325 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-User: tempest-AttachVolumeTestJSON-1621945621-project Jun 16 23:07:38.401325 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-User-Domain-Id: default Jun 16 23:07:38.401325 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-User-Domain-Name: Default Jun 16 23:07:38.401325 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-User-Id: 6a993f5d14b64fccad723abecfcadf90 Jun 16 23:07:38.401325 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-User-Name: tempest-AttachVolumeTestJSON-1621945621-project Jun 16 23:07:38.401325 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: method: > Jun 16 23:07:38.401325 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: exception: Instance b7619c39-737f-440b-b676-8e920380d6c6 could not be found. Jun 16 23:07:38.401325 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: action_args: {'id': 'b7619c39-737f-440b-b676-8e920380d6c6'} Jun 16 23:07:38.405738 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 23:07:38.405738 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 23:07:38.405738 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 23:07:38.405738 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 23:07:38.405738 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 23:07:38.405738 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 23:07:38.405738 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 23:07:38.405738 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 23:07:38.405738 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 23:07:38.405738 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 23:07:38.405738 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7619c39-737f-440b-b676-8e920380d6c6 could not be found. Jun 16 23:07:38.405738 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 16 23:07:38.405738 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 23:07:38.405738 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 16 23:07:38.405738 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 23:07:38.405738 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 23:07:38.405738 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 23:07:38.405738 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 23:07:38.405738 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 23:07:38.405738 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 23:07:38.407024 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 23:07:38.407024 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 23:07:38.407024 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 23:07:38.407024 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 23:07:38.407024 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 23:07:38.407024 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 23:07:38.407024 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 23:07:38.407024 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 23:07:38.407024 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 23:07:38.407024 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7619c39-737f-440b-b676-8e920380d6c6 could not be found. Jun 16 23:07:38.407024 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 16 23:07:38.407024 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 23:07:38.407024 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 16 23:07:38.407024 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 23:07:38.407024 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 23:07:38.407024 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 23:07:38.407024 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 23:07:38.407024 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 23:07:38.407024 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7619c39-737f-440b-b676-8e920380d6c6 could not be found. Jun 16 23:07:38.407024 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 16 23:07:38.408257 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-bbb5bd55-40ad-4937-8d8d-424812f3f083 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Returning 404 to user: Instance b7619c39-737f-440b-b676-8e920380d6c6 could not be found. {{(pid=117563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 23:07:38.408257 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-bbb5bd55-40ad-4937-8d8d-424812f3f083 tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] 10.222.0.17 "DELETE /compute/v2.1/servers/b7619c39-737f-440b-b676-8e920380d6c6" status: 404 len: 111 microversion: 2.1 time: 0.034704 Jun 16 23:07:38.408257 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 466/946] 10.222.0.17 () {58 vars in 1238 bytes} [Thu Jun 16 23:07:38 2022] DELETE /compute/v2.1/servers/b7619c39-737f-440b-b676-8e920380d6c6 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 23:07:38.414550 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-df52a964-3f04-4c68-84b1-9167b96a6b3d tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:07:38.415771 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-df52a964-3f04-4c68-84b1-9167b96a6b3d tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] [instance: b7619c39-737f-440b-b676-8e920380d6c6] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:07:38.419385 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG dbcounter [-] [117562] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=117562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 23:07:38.429185 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-df52a964-3f04-4c68-84b1-9167b96a6b3d tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:07:38.430196 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-df52a964-3f04-4c68-84b1-9167b96a6b3d tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:07:38.432056 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-df52a964-3f04-4c68-84b1-9167b96a6b3d tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:07:38.433265 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-df52a964-3f04-4c68-84b1-9167b96a6b3d tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:07:38.455482 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.wsgi [None req-df52a964-3f04-4c68-84b1-9167b96a6b3d tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] HTTP exception thrown: Instance b7619c39-737f-440b-b676-8e920380d6c6 could not be found. Jun 16 23:07:38.472554 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-df52a964-3f04-4c68-84b1-9167b96a6b3d tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Request method failure captured: Jun 16 23:07:38.472554 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: request: GET /compute/v2.1/servers/b7619c39-737f-440b-b676-8e920380d6c6 HTTP/1.1 Jun 16 23:07:38.472554 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Accept: application/json Jun 16 23:07:38.472554 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Accept-Encoding: identity Jun 16 23:07:38.472554 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Connection: close Jun 16 23:07:38.472554 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Content-Length: 0 Jun 16 23:07:38.472554 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Content-Type: application/json Jun 16 23:07:38.472554 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Host: 10.222.0.17 Jun 16 23:07:38.472554 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Openstack-System-Scope: None Jun 16 23:07:38.472554 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: User-Agent: python-urllib3/1.26.9 Jun 16 23:07:38.472554 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Auth-Token: gAAAAABiq7Ybkk4rah_fv4iIT3idoyxagEJSApfLNzYq7Fra8s6MuOetujUSvchI7nZZPa3uftYuuLfFRK893xYPK0M7YIPcU59Mp2UTI5ytwc6UmxRGSLxfQa_itibxYb7ELKNBXf5r_xsHXxmPbxfkW6tU28wgKVjK4ck02G_3-DW1dXLlatw Jun 16 23:07:38.472554 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Domain-Id: None Jun 16 23:07:38.472554 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Domain-Name: None Jun 16 23:07:38.472554 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Identity-Status: Confirmed Jun 16 23:07:38.472554 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Is-Admin-Project: True Jun 16 23:07:38.472554 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Project-Domain-Id: default Jun 16 23:07:38.472554 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Project-Domain-Name: Default Jun 16 23:07:38.472554 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Project-Id: f3b1be8431b0434d8bd6abca293127d5 Jun 16 23:07:38.472554 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Project-Name: tempest-AttachVolumeTestJSON-1621945621 Jun 16 23:07:38.472554 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Role: member,reader Jun 16 23:07:38.472554 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Roles: member,reader Jun 16 23:07:38.474043 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/f3b1be8431b0434d8bd6abca293127d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_f3b1be8431b0434d8bd6abca293127d5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f3b1be8431b0434d8bd6abca293127d5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f3b1be8431b0434d8bd6abca293127d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Jun 16 23:07:38.474043 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Tenant: tempest-AttachVolumeTestJSON-1621945621 Jun 16 23:07:38.474043 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Tenant-Id: f3b1be8431b0434d8bd6abca293127d5 Jun 16 23:07:38.474043 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1621945621 Jun 16 23:07:38.474043 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-User: tempest-AttachVolumeTestJSON-1621945621-project Jun 16 23:07:38.474043 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-User-Domain-Id: default Jun 16 23:07:38.474043 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-User-Domain-Name: Default Jun 16 23:07:38.474043 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-User-Id: 6a993f5d14b64fccad723abecfcadf90 Jun 16 23:07:38.474043 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-User-Name: tempest-AttachVolumeTestJSON-1621945621-project Jun 16 23:07:38.474043 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: method: > Jun 16 23:07:38.474043 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: exception: Instance b7619c39-737f-440b-b676-8e920380d6c6 could not be found. Jun 16 23:07:38.474043 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: action_args: {'id': 'b7619c39-737f-440b-b676-8e920380d6c6'} Jun 16 23:07:38.474828 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 23:07:38.474828 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 23:07:38.474828 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 23:07:38.474828 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 23:07:38.474828 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 23:07:38.474828 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 23:07:38.474828 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 23:07:38.474828 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 23:07:38.474828 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 23:07:38.474828 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 23:07:38.474828 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7619c39-737f-440b-b676-8e920380d6c6 could not be found. Jun 16 23:07:38.474828 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Jun 16 23:07:38.474828 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 23:07:38.474828 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Jun 16 23:07:38.474828 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 23:07:38.474828 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 23:07:38.474828 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 23:07:38.474828 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 23:07:38.474828 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 23:07:38.474828 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 23:07:38.476011 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 23:07:38.476011 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 23:07:38.476011 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 23:07:38.476011 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 23:07:38.476011 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 23:07:38.476011 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 23:07:38.476011 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 23:07:38.476011 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7619c39-737f-440b-b676-8e920380d6c6 could not be found. Jun 16 23:07:38.476011 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Jun 16 23:07:38.476011 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 23:07:38.476011 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Jun 16 23:07:38.476011 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 23:07:38.476011 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 23:07:38.476011 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 23:07:38.476011 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 23:07:38.476011 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 23:07:38.476011 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7619c39-737f-440b-b676-8e920380d6c6 could not be found. Jun 16 23:07:38.476011 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Jun 16 23:07:38.479135 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-df52a964-3f04-4c68-84b1-9167b96a6b3d tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Returning 404 to user: Instance b7619c39-737f-440b-b676-8e920380d6c6 could not be found. {{(pid=117562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 23:07:38.480891 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-df52a964-3f04-4c68-84b1-9167b96a6b3d tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] 10.222.0.17 "GET /compute/v2.1/servers/b7619c39-737f-440b-b676-8e920380d6c6" status: 404 len: 111 microversion: 2.1 time: 0.070161 Jun 16 23:07:38.481697 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 481/947] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:07:38 2022] GET /compute/v2.1/servers/b7619c39-737f-440b-b676-8e920380d6c6 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 23:07:38.883165 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-a2f3dd63-cc27-406b-bc84-159ce8e5b074 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:07:38.885205 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-a2f3dd63-cc27-406b-bc84-159ce8e5b074 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] [instance: 30b2118a-225b-457b-a15d-cf7656c69331] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:07:38.904302 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-a2f3dd63-cc27-406b-bc84-159ce8e5b074 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:07:38.905695 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-a2f3dd63-cc27-406b-bc84-159ce8e5b074 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:07:38.907919 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-a2f3dd63-cc27-406b-bc84-159ce8e5b074 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:07:38.908930 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-a2f3dd63-cc27-406b-bc84-159ce8e5b074 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:07:38.931429 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.wsgi [None req-a2f3dd63-cc27-406b-bc84-159ce8e5b074 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] HTTP exception thrown: Instance 30b2118a-225b-457b-a15d-cf7656c69331 could not be found. Jun 16 23:07:38.935164 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-a2f3dd63-cc27-406b-bc84-159ce8e5b074 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Request method failure captured: Jun 16 23:07:38.935164 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: request: DELETE /compute/v2.1/servers/30b2118a-225b-457b-a15d-cf7656c69331 HTTP/1.1 Jun 16 23:07:38.935164 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Accept: application/json Jun 16 23:07:38.935164 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Accept-Encoding: identity Jun 16 23:07:38.935164 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Connection: close Jun 16 23:07:38.935164 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Content-Length: 0 Jun 16 23:07:38.935164 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Content-Type: application/json Jun 16 23:07:38.935164 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Host: 10.222.0.17 Jun 16 23:07:38.935164 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Openstack-System-Scope: None Jun 16 23:07:38.935164 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: User-Agent: python-urllib3/1.26.9 Jun 16 23:07:38.935164 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Auth-Token: gAAAAABiq7YeRQnlz8l2GSIF0VOET6Y1W8yBB5oz1cYYpYFcfT7cYY0kIvo4O2qRVrDvagXVbkghr-k-KGb8GCGo_mbQOK1vAXciruDemULKCP_QAI9xPZafRW81TxgAIAvJEx6CPJUGbCIq4SyYsx25OB1SZXBFh8aRZWpbG6CQ65KEZvQlgIo Jun 16 23:07:38.935164 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Domain-Id: None Jun 16 23:07:38.935164 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Domain-Name: None Jun 16 23:07:38.935164 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Identity-Status: Confirmed Jun 16 23:07:38.935164 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Is-Admin-Project: True Jun 16 23:07:38.935164 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Project-Domain-Id: default Jun 16 23:07:38.935164 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Project-Domain-Name: Default Jun 16 23:07:38.935164 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Project-Id: 0526c12e8bc947209e24daf5ddfad7be Jun 16 23:07:38.935164 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Project-Name: tempest-AttachVolumeNegativeTest-1967724585 Jun 16 23:07:38.935164 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Role: member,reader Jun 16 23:07:38.935164 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Roles: member,reader Jun 16 23:07:38.936870 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/0526c12e8bc947209e24daf5ddfad7be"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_0526c12e8bc947209e24daf5ddfad7be"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0526c12e8bc947209e24daf5ddfad7be"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0526c12e8bc947209e24daf5ddfad7be"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Jun 16 23:07:38.936870 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Tenant: tempest-AttachVolumeNegativeTest-1967724585 Jun 16 23:07:38.936870 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Tenant-Id: 0526c12e8bc947209e24daf5ddfad7be Jun 16 23:07:38.936870 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1967724585 Jun 16 23:07:38.936870 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-User: tempest-AttachVolumeNegativeTest-1967724585-project Jun 16 23:07:38.936870 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-User-Domain-Id: default Jun 16 23:07:38.936870 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-User-Domain-Name: Default Jun 16 23:07:38.936870 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-User-Id: 9e3a2d16133b4af8a208682de8a7d111 Jun 16 23:07:38.936870 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-User-Name: tempest-AttachVolumeNegativeTest-1967724585-project Jun 16 23:07:38.936870 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: method: > Jun 16 23:07:38.936870 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: exception: Instance 30b2118a-225b-457b-a15d-cf7656c69331 could not be found. Jun 16 23:07:38.936870 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: action_args: {'id': '30b2118a-225b-457b-a15d-cf7656c69331'} Jun 16 23:07:38.937742 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 23:07:38.937742 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 23:07:38.937742 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 23:07:38.937742 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 23:07:38.937742 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 23:07:38.937742 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 23:07:38.937742 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 23:07:38.937742 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 23:07:38.937742 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 23:07:38.937742 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 23:07:38.937742 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 30b2118a-225b-457b-a15d-cf7656c69331 could not be found. Jun 16 23:07:38.937742 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 16 23:07:38.937742 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 23:07:38.937742 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 16 23:07:38.937742 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 23:07:38.937742 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 23:07:38.937742 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 23:07:38.937742 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 23:07:38.937742 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 23:07:38.937742 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 23:07:38.939292 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 23:07:38.939292 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 23:07:38.939292 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 23:07:38.939292 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 23:07:38.939292 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 23:07:38.939292 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 23:07:38.939292 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 23:07:38.939292 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 23:07:38.939292 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 23:07:38.939292 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30b2118a-225b-457b-a15d-cf7656c69331 could not be found. Jun 16 23:07:38.939292 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 16 23:07:38.939292 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 23:07:38.939292 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 16 23:07:38.939292 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 23:07:38.939292 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 23:07:38.939292 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 23:07:38.939292 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 23:07:38.939292 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 23:07:38.939292 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30b2118a-225b-457b-a15d-cf7656c69331 could not be found. Jun 16 23:07:38.939292 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 16 23:07:38.943563 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-a2f3dd63-cc27-406b-bc84-159ce8e5b074 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Returning 404 to user: Instance 30b2118a-225b-457b-a15d-cf7656c69331 could not be found. {{(pid=117563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 23:07:38.945082 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-a2f3dd63-cc27-406b-bc84-159ce8e5b074 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] 10.222.0.17 "DELETE /compute/v2.1/servers/30b2118a-225b-457b-a15d-cf7656c69331" status: 404 len: 111 microversion: 2.1 time: 0.070334 Jun 16 23:07:38.946482 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 467/948] 10.222.0.17 () {58 vars in 1238 bytes} [Thu Jun 16 23:07:38 2022] DELETE /compute/v2.1/servers/30b2118a-225b-457b-a15d-cf7656c69331 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 23:07:38.957908 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-1dbeb880-fe3e-44c5-9b75-1725699e30f9 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:07:38.959912 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-1dbeb880-fe3e-44c5-9b75-1725699e30f9 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] [instance: 30b2118a-225b-457b-a15d-cf7656c69331] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:07:38.969898 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-1dbeb880-fe3e-44c5-9b75-1725699e30f9 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:07:38.970650 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-1dbeb880-fe3e-44c5-9b75-1725699e30f9 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:07:38.972261 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-1dbeb880-fe3e-44c5-9b75-1725699e30f9 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:07:38.973216 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-1dbeb880-fe3e-44c5-9b75-1725699e30f9 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:07:39.008596 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.wsgi [None req-1dbeb880-fe3e-44c5-9b75-1725699e30f9 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] HTTP exception thrown: Instance 30b2118a-225b-457b-a15d-cf7656c69331 could not be found. Jun 16 23:07:39.010853 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-1dbeb880-fe3e-44c5-9b75-1725699e30f9 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Request method failure captured: Jun 16 23:07:39.010853 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: request: GET /compute/v2.1/servers/30b2118a-225b-457b-a15d-cf7656c69331 HTTP/1.1 Jun 16 23:07:39.010853 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Accept: application/json Jun 16 23:07:39.010853 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Accept-Encoding: identity Jun 16 23:07:39.010853 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Connection: close Jun 16 23:07:39.010853 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Content-Length: 0 Jun 16 23:07:39.010853 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Content-Type: application/json Jun 16 23:07:39.010853 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Host: 10.222.0.17 Jun 16 23:07:39.010853 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Openstack-System-Scope: None Jun 16 23:07:39.010853 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: User-Agent: python-urllib3/1.26.9 Jun 16 23:07:39.010853 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Auth-Token: gAAAAABiq7YeRQnlz8l2GSIF0VOET6Y1W8yBB5oz1cYYpYFcfT7cYY0kIvo4O2qRVrDvagXVbkghr-k-KGb8GCGo_mbQOK1vAXciruDemULKCP_QAI9xPZafRW81TxgAIAvJEx6CPJUGbCIq4SyYsx25OB1SZXBFh8aRZWpbG6CQ65KEZvQlgIo Jun 16 23:07:39.010853 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Domain-Id: None Jun 16 23:07:39.010853 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Domain-Name: None Jun 16 23:07:39.010853 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Identity-Status: Confirmed Jun 16 23:07:39.010853 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Is-Admin-Project: True Jun 16 23:07:39.010853 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Project-Domain-Id: default Jun 16 23:07:39.010853 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Project-Domain-Name: Default Jun 16 23:07:39.010853 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Project-Id: 0526c12e8bc947209e24daf5ddfad7be Jun 16 23:07:39.010853 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Project-Name: tempest-AttachVolumeNegativeTest-1967724585 Jun 16 23:07:39.010853 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Role: member,reader Jun 16 23:07:39.010853 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Roles: member,reader Jun 16 23:07:39.013489 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/0526c12e8bc947209e24daf5ddfad7be"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_0526c12e8bc947209e24daf5ddfad7be"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0526c12e8bc947209e24daf5ddfad7be"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0526c12e8bc947209e24daf5ddfad7be"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Jun 16 23:07:39.013489 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Tenant: tempest-AttachVolumeNegativeTest-1967724585 Jun 16 23:07:39.013489 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Tenant-Id: 0526c12e8bc947209e24daf5ddfad7be Jun 16 23:07:39.013489 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1967724585 Jun 16 23:07:39.013489 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-User: tempest-AttachVolumeNegativeTest-1967724585-project Jun 16 23:07:39.013489 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-User-Domain-Id: default Jun 16 23:07:39.013489 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-User-Domain-Name: Default Jun 16 23:07:39.013489 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-User-Id: 9e3a2d16133b4af8a208682de8a7d111 Jun 16 23:07:39.013489 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-User-Name: tempest-AttachVolumeNegativeTest-1967724585-project Jun 16 23:07:39.013489 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: method: > Jun 16 23:07:39.013489 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: exception: Instance 30b2118a-225b-457b-a15d-cf7656c69331 could not be found. Jun 16 23:07:39.013489 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: action_args: {'id': '30b2118a-225b-457b-a15d-cf7656c69331'} Jun 16 23:07:39.014546 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 23:07:39.014546 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 23:07:39.014546 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 23:07:39.014546 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 23:07:39.014546 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 23:07:39.014546 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 23:07:39.014546 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 23:07:39.014546 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 23:07:39.014546 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 23:07:39.014546 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 23:07:39.014546 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 30b2118a-225b-457b-a15d-cf7656c69331 could not be found. Jun 16 23:07:39.014546 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Jun 16 23:07:39.014546 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 23:07:39.014546 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Jun 16 23:07:39.014546 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 23:07:39.014546 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 23:07:39.014546 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 23:07:39.014546 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 23:07:39.014546 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 23:07:39.014546 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 23:07:39.016252 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 23:07:39.016252 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 23:07:39.016252 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 23:07:39.016252 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 23:07:39.016252 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 23:07:39.016252 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 23:07:39.016252 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 23:07:39.016252 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30b2118a-225b-457b-a15d-cf7656c69331 could not be found. Jun 16 23:07:39.016252 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Jun 16 23:07:39.016252 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 23:07:39.016252 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Jun 16 23:07:39.016252 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 23:07:39.016252 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 23:07:39.016252 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 23:07:39.016252 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 23:07:39.016252 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 23:07:39.016252 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30b2118a-225b-457b-a15d-cf7656c69331 could not be found. Jun 16 23:07:39.016252 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Jun 16 23:07:39.019584 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-1dbeb880-fe3e-44c5-9b75-1725699e30f9 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Returning 404 to user: Instance 30b2118a-225b-457b-a15d-cf7656c69331 could not be found. {{(pid=117562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 23:07:39.020825 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-1dbeb880-fe3e-44c5-9b75-1725699e30f9 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] 10.222.0.17 "GET /compute/v2.1/servers/30b2118a-225b-457b-a15d-cf7656c69331" status: 404 len: 111 microversion: 2.1 time: 0.069425 Jun 16 23:07:39.025140 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 482/949] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:07:38 2022] GET /compute/v2.1/servers/30b2118a-225b-457b-a15d-cf7656c69331 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 23:07:39.032110 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-755b55be-de18-42ec-b0eb-9b64eb8ae1d8 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:07:39.033395 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-755b55be-de18-42ec-b0eb-9b64eb8ae1d8 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] [instance: 22fa37ae-2cac-42ad-9332-ab7da7c574d5] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:07:39.044619 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-755b55be-de18-42ec-b0eb-9b64eb8ae1d8 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:07:39.045670 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-755b55be-de18-42ec-b0eb-9b64eb8ae1d8 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:07:39.047230 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-755b55be-de18-42ec-b0eb-9b64eb8ae1d8 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:07:39.047943 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-755b55be-de18-42ec-b0eb-9b64eb8ae1d8 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:07:39.067881 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.wsgi [None req-755b55be-de18-42ec-b0eb-9b64eb8ae1d8 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] HTTP exception thrown: Instance 22fa37ae-2cac-42ad-9332-ab7da7c574d5 could not be found. Jun 16 23:07:39.069683 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-755b55be-de18-42ec-b0eb-9b64eb8ae1d8 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Request method failure captured: Jun 16 23:07:39.069683 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: request: DELETE /compute/v2.1/servers/22fa37ae-2cac-42ad-9332-ab7da7c574d5 HTTP/1.1 Jun 16 23:07:39.069683 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Accept: application/json Jun 16 23:07:39.069683 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Accept-Encoding: identity Jun 16 23:07:39.069683 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Connection: close Jun 16 23:07:39.069683 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Content-Length: 0 Jun 16 23:07:39.069683 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Content-Type: application/json Jun 16 23:07:39.069683 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Host: 10.222.0.17 Jun 16 23:07:39.069683 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Openstack-System-Scope: None Jun 16 23:07:39.069683 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: User-Agent: python-urllib3/1.26.9 Jun 16 23:07:39.069683 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Auth-Token: gAAAAABiq7YeRQnlz8l2GSIF0VOET6Y1W8yBB5oz1cYYpYFcfT7cYY0kIvo4O2qRVrDvagXVbkghr-k-KGb8GCGo_mbQOK1vAXciruDemULKCP_QAI9xPZafRW81TxgAIAvJEx6CPJUGbCIq4SyYsx25OB1SZXBFh8aRZWpbG6CQ65KEZvQlgIo Jun 16 23:07:39.069683 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Domain-Id: None Jun 16 23:07:39.069683 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Domain-Name: None Jun 16 23:07:39.069683 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Identity-Status: Confirmed Jun 16 23:07:39.069683 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Is-Admin-Project: True Jun 16 23:07:39.069683 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Project-Domain-Id: default Jun 16 23:07:39.069683 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Project-Domain-Name: Default Jun 16 23:07:39.069683 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Project-Id: 0526c12e8bc947209e24daf5ddfad7be Jun 16 23:07:39.069683 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Project-Name: tempest-AttachVolumeNegativeTest-1967724585 Jun 16 23:07:39.069683 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Role: member,reader Jun 16 23:07:39.069683 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Roles: member,reader Jun 16 23:07:39.071145 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/0526c12e8bc947209e24daf5ddfad7be"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_0526c12e8bc947209e24daf5ddfad7be"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0526c12e8bc947209e24daf5ddfad7be"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0526c12e8bc947209e24daf5ddfad7be"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Jun 16 23:07:39.071145 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Tenant: tempest-AttachVolumeNegativeTest-1967724585 Jun 16 23:07:39.071145 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Tenant-Id: 0526c12e8bc947209e24daf5ddfad7be Jun 16 23:07:39.071145 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1967724585 Jun 16 23:07:39.071145 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-User: tempest-AttachVolumeNegativeTest-1967724585-project Jun 16 23:07:39.071145 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-User-Domain-Id: default Jun 16 23:07:39.071145 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-User-Domain-Name: Default Jun 16 23:07:39.071145 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-User-Id: 9e3a2d16133b4af8a208682de8a7d111 Jun 16 23:07:39.071145 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-User-Name: tempest-AttachVolumeNegativeTest-1967724585-project Jun 16 23:07:39.071145 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: method: > Jun 16 23:07:39.071145 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: exception: Instance 22fa37ae-2cac-42ad-9332-ab7da7c574d5 could not be found. Jun 16 23:07:39.071145 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: action_args: {'id': '22fa37ae-2cac-42ad-9332-ab7da7c574d5'} Jun 16 23:07:39.071879 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 23:07:39.071879 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 23:07:39.071879 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 23:07:39.071879 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 23:07:39.071879 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 23:07:39.071879 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 23:07:39.071879 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 23:07:39.071879 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 23:07:39.071879 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 23:07:39.071879 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 23:07:39.071879 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22fa37ae-2cac-42ad-9332-ab7da7c574d5 could not be found. Jun 16 23:07:39.071879 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 16 23:07:39.071879 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 23:07:39.071879 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 16 23:07:39.071879 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 23:07:39.071879 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 23:07:39.071879 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 23:07:39.071879 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 23:07:39.071879 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 23:07:39.071879 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 23:07:39.074316 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 23:07:39.074316 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 23:07:39.074316 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 23:07:39.074316 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 23:07:39.074316 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 23:07:39.074316 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 23:07:39.074316 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 23:07:39.074316 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 23:07:39.074316 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 23:07:39.074316 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22fa37ae-2cac-42ad-9332-ab7da7c574d5 could not be found. Jun 16 23:07:39.074316 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 16 23:07:39.074316 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 23:07:39.074316 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 16 23:07:39.074316 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 23:07:39.074316 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 23:07:39.074316 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 23:07:39.074316 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 23:07:39.074316 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 23:07:39.074316 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22fa37ae-2cac-42ad-9332-ab7da7c574d5 could not be found. Jun 16 23:07:39.074316 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 16 23:07:39.076048 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-755b55be-de18-42ec-b0eb-9b64eb8ae1d8 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Returning 404 to user: Instance 22fa37ae-2cac-42ad-9332-ab7da7c574d5 could not be found. {{(pid=117563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 23:07:39.076048 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-755b55be-de18-42ec-b0eb-9b64eb8ae1d8 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] 10.222.0.17 "DELETE /compute/v2.1/servers/22fa37ae-2cac-42ad-9332-ab7da7c574d5" status: 404 len: 111 microversion: 2.1 time: 0.045163 Jun 16 23:07:39.082940 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-17aba6e9-9bc6-4760-ab92-7708121e7e2c tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:07:39.083767 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-17aba6e9-9bc6-4760-ab92-7708121e7e2c tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] [instance: 22fa37ae-2cac-42ad-9332-ab7da7c574d5] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:07:39.088489 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 468/950] 10.222.0.17 () {58 vars in 1238 bytes} [Thu Jun 16 23:07:39 2022] DELETE /compute/v2.1/servers/22fa37ae-2cac-42ad-9332-ab7da7c574d5 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 23:07:39.092338 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-17aba6e9-9bc6-4760-ab92-7708121e7e2c tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:07:39.092757 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-17aba6e9-9bc6-4760-ab92-7708121e7e2c tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:07:39.093794 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-17aba6e9-9bc6-4760-ab92-7708121e7e2c tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:07:39.094309 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-17aba6e9-9bc6-4760-ab92-7708121e7e2c tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:07:39.110839 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.wsgi [None req-17aba6e9-9bc6-4760-ab92-7708121e7e2c tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] HTTP exception thrown: Instance 22fa37ae-2cac-42ad-9332-ab7da7c574d5 could not be found. Jun 16 23:07:39.113121 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-17aba6e9-9bc6-4760-ab92-7708121e7e2c tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Request method failure captured: Jun 16 23:07:39.113121 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: request: GET /compute/v2.1/servers/22fa37ae-2cac-42ad-9332-ab7da7c574d5 HTTP/1.1 Jun 16 23:07:39.113121 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Accept: application/json Jun 16 23:07:39.113121 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Accept-Encoding: identity Jun 16 23:07:39.113121 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Connection: close Jun 16 23:07:39.113121 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Content-Length: 0 Jun 16 23:07:39.113121 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Content-Type: application/json Jun 16 23:07:39.113121 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Host: 10.222.0.17 Jun 16 23:07:39.113121 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Openstack-System-Scope: None Jun 16 23:07:39.113121 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: User-Agent: python-urllib3/1.26.9 Jun 16 23:07:39.113121 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Auth-Token: gAAAAABiq7YeRQnlz8l2GSIF0VOET6Y1W8yBB5oz1cYYpYFcfT7cYY0kIvo4O2qRVrDvagXVbkghr-k-KGb8GCGo_mbQOK1vAXciruDemULKCP_QAI9xPZafRW81TxgAIAvJEx6CPJUGbCIq4SyYsx25OB1SZXBFh8aRZWpbG6CQ65KEZvQlgIo Jun 16 23:07:39.113121 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Domain-Id: None Jun 16 23:07:39.113121 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Domain-Name: None Jun 16 23:07:39.113121 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Identity-Status: Confirmed Jun 16 23:07:39.113121 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Is-Admin-Project: True Jun 16 23:07:39.113121 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Project-Domain-Id: default Jun 16 23:07:39.113121 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Project-Domain-Name: Default Jun 16 23:07:39.113121 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Project-Id: 0526c12e8bc947209e24daf5ddfad7be Jun 16 23:07:39.113121 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Project-Name: tempest-AttachVolumeNegativeTest-1967724585 Jun 16 23:07:39.113121 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Role: member,reader Jun 16 23:07:39.113121 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Roles: member,reader Jun 16 23:07:39.114778 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/0526c12e8bc947209e24daf5ddfad7be"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_0526c12e8bc947209e24daf5ddfad7be"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0526c12e8bc947209e24daf5ddfad7be"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0526c12e8bc947209e24daf5ddfad7be"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Jun 16 23:07:39.114778 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Tenant: tempest-AttachVolumeNegativeTest-1967724585 Jun 16 23:07:39.114778 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Tenant-Id: 0526c12e8bc947209e24daf5ddfad7be Jun 16 23:07:39.114778 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1967724585 Jun 16 23:07:39.114778 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-User: tempest-AttachVolumeNegativeTest-1967724585-project Jun 16 23:07:39.114778 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-User-Domain-Id: default Jun 16 23:07:39.114778 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-User-Domain-Name: Default Jun 16 23:07:39.114778 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-User-Id: 9e3a2d16133b4af8a208682de8a7d111 Jun 16 23:07:39.114778 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-User-Name: tempest-AttachVolumeNegativeTest-1967724585-project Jun 16 23:07:39.114778 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: method: > Jun 16 23:07:39.114778 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: exception: Instance 22fa37ae-2cac-42ad-9332-ab7da7c574d5 could not be found. Jun 16 23:07:39.114778 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: action_args: {'id': '22fa37ae-2cac-42ad-9332-ab7da7c574d5'} Jun 16 23:07:39.115559 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 23:07:39.115559 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 23:07:39.115559 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 23:07:39.115559 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 23:07:39.115559 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 23:07:39.115559 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 23:07:39.115559 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 23:07:39.115559 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 23:07:39.115559 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 23:07:39.115559 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 23:07:39.115559 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22fa37ae-2cac-42ad-9332-ab7da7c574d5 could not be found. Jun 16 23:07:39.115559 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Jun 16 23:07:39.115559 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 23:07:39.115559 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Jun 16 23:07:39.115559 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 23:07:39.115559 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 23:07:39.115559 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 23:07:39.115559 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 23:07:39.115559 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 23:07:39.115559 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 23:07:39.116786 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 23:07:39.116786 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 23:07:39.116786 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 23:07:39.116786 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 23:07:39.116786 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 23:07:39.116786 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 23:07:39.116786 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 23:07:39.116786 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22fa37ae-2cac-42ad-9332-ab7da7c574d5 could not be found. Jun 16 23:07:39.116786 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Jun 16 23:07:39.116786 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 23:07:39.116786 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Jun 16 23:07:39.116786 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 23:07:39.116786 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 23:07:39.116786 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 23:07:39.116786 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 23:07:39.116786 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 23:07:39.116786 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22fa37ae-2cac-42ad-9332-ab7da7c574d5 could not be found. Jun 16 23:07:39.116786 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Jun 16 23:07:39.120008 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-17aba6e9-9bc6-4760-ab92-7708121e7e2c tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Returning 404 to user: Instance 22fa37ae-2cac-42ad-9332-ab7da7c574d5 could not be found. {{(pid=117562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 23:07:39.122099 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-17aba6e9-9bc6-4760-ab92-7708121e7e2c tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] 10.222.0.17 "GET /compute/v2.1/servers/22fa37ae-2cac-42ad-9332-ab7da7c574d5" status: 404 len: 111 microversion: 2.1 time: 0.043653 Jun 16 23:07:39.126262 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 483/951] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:07:39 2022] GET /compute/v2.1/servers/22fa37ae-2cac-42ad-9332-ab7da7c574d5 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 23:07:39.690551 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-cc5ca854-06b6-4381-a969-2c4b304687ed tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:07:39.691090 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-cc5ca854-06b6-4381-a969-2c4b304687ed tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] [instance: f4c73822-1dfa-4eed-bf02-1123b0402755] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:07:39.697718 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-cc5ca854-06b6-4381-a969-2c4b304687ed tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:07:39.698188 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-cc5ca854-06b6-4381-a969-2c4b304687ed tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:07:39.699533 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-cc5ca854-06b6-4381-a969-2c4b304687ed tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:07:39.700272 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-cc5ca854-06b6-4381-a969-2c4b304687ed tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:07:39.714794 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.wsgi [None req-cc5ca854-06b6-4381-a969-2c4b304687ed tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] HTTP exception thrown: Instance f4c73822-1dfa-4eed-bf02-1123b0402755 could not be found. Jun 16 23:07:39.716409 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-cc5ca854-06b6-4381-a969-2c4b304687ed tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Request method failure captured: Jun 16 23:07:39.716409 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: request: DELETE /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755 HTTP/1.1 Jun 16 23:07:39.716409 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Accept: application/json Jun 16 23:07:39.716409 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Accept-Encoding: identity Jun 16 23:07:39.716409 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Connection: close Jun 16 23:07:39.716409 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Content-Length: 0 Jun 16 23:07:39.716409 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Content-Type: application/json Jun 16 23:07:39.716409 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Host: 10.222.0.17 Jun 16 23:07:39.716409 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Openstack-System-Scope: None Jun 16 23:07:39.716409 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: User-Agent: python-urllib3/1.26.9 Jun 16 23:07:39.716409 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Auth-Token: gAAAAABiq7Ybkk4rah_fv4iIT3idoyxagEJSApfLNzYq7Fra8s6MuOetujUSvchI7nZZPa3uftYuuLfFRK893xYPK0M7YIPcU59Mp2UTI5ytwc6UmxRGSLxfQa_itibxYb7ELKNBXf5r_xsHXxmPbxfkW6tU28wgKVjK4ck02G_3-DW1dXLlatw Jun 16 23:07:39.716409 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Domain-Id: None Jun 16 23:07:39.716409 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Domain-Name: None Jun 16 23:07:39.716409 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Identity-Status: Confirmed Jun 16 23:07:39.716409 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Is-Admin-Project: True Jun 16 23:07:39.716409 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Project-Domain-Id: default Jun 16 23:07:39.716409 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Project-Domain-Name: Default Jun 16 23:07:39.716409 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Project-Id: f3b1be8431b0434d8bd6abca293127d5 Jun 16 23:07:39.716409 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Project-Name: tempest-AttachVolumeTestJSON-1621945621 Jun 16 23:07:39.716409 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Role: member,reader Jun 16 23:07:39.716409 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Roles: member,reader Jun 16 23:07:39.717756 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/f3b1be8431b0434d8bd6abca293127d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_f3b1be8431b0434d8bd6abca293127d5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f3b1be8431b0434d8bd6abca293127d5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f3b1be8431b0434d8bd6abca293127d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Jun 16 23:07:39.717756 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Tenant: tempest-AttachVolumeTestJSON-1621945621 Jun 16 23:07:39.717756 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Tenant-Id: f3b1be8431b0434d8bd6abca293127d5 Jun 16 23:07:39.717756 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1621945621 Jun 16 23:07:39.717756 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-User: tempest-AttachVolumeTestJSON-1621945621-project Jun 16 23:07:39.717756 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-User-Domain-Id: default Jun 16 23:07:39.717756 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-User-Domain-Name: Default Jun 16 23:07:39.717756 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-User-Id: 6a993f5d14b64fccad723abecfcadf90 Jun 16 23:07:39.717756 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-User-Name: tempest-AttachVolumeTestJSON-1621945621-project Jun 16 23:07:39.717756 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: method: > Jun 16 23:07:39.717756 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: exception: Instance f4c73822-1dfa-4eed-bf02-1123b0402755 could not be found. Jun 16 23:07:39.717756 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: action_args: {'id': 'f4c73822-1dfa-4eed-bf02-1123b0402755'} Jun 16 23:07:39.718513 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 23:07:39.718513 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 23:07:39.718513 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 23:07:39.718513 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 23:07:39.718513 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 23:07:39.718513 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 23:07:39.718513 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 23:07:39.718513 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 23:07:39.718513 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 23:07:39.718513 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 23:07:39.718513 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4c73822-1dfa-4eed-bf02-1123b0402755 could not be found. Jun 16 23:07:39.718513 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 16 23:07:39.718513 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 23:07:39.718513 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 16 23:07:39.718513 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 23:07:39.718513 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 23:07:39.718513 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 23:07:39.718513 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 23:07:39.718513 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 23:07:39.718513 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 23:07:39.719757 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 23:07:39.719757 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 23:07:39.719757 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 23:07:39.719757 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 23:07:39.719757 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 23:07:39.719757 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 23:07:39.719757 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 23:07:39.719757 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 23:07:39.719757 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 23:07:39.719757 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4c73822-1dfa-4eed-bf02-1123b0402755 could not be found. Jun 16 23:07:39.719757 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 16 23:07:39.719757 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 23:07:39.719757 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 16 23:07:39.719757 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 23:07:39.719757 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 23:07:39.719757 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 23:07:39.719757 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 23:07:39.719757 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 23:07:39.719757 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4c73822-1dfa-4eed-bf02-1123b0402755 could not be found. Jun 16 23:07:39.719757 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 16 23:07:39.721754 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-cc5ca854-06b6-4381-a969-2c4b304687ed tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Returning 404 to user: Instance f4c73822-1dfa-4eed-bf02-1123b0402755 could not be found. {{(pid=117563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 23:07:39.721754 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-cc5ca854-06b6-4381-a969-2c4b304687ed tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] 10.222.0.17 "DELETE /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755" status: 404 len: 111 microversion: 2.1 time: 0.031501 Jun 16 23:07:39.721754 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 469/952] 10.222.0.17 () {58 vars in 1238 bytes} [Thu Jun 16 23:07:39 2022] DELETE /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 23:07:39.726665 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-c51a7921-8d5b-4e4e-b0c0-4a3822a61c5d tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:07:39.727423 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-c51a7921-8d5b-4e4e-b0c0-4a3822a61c5d tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] [instance: f4c73822-1dfa-4eed-bf02-1123b0402755] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:07:39.734770 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-c51a7921-8d5b-4e4e-b0c0-4a3822a61c5d tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:07:39.735314 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-c51a7921-8d5b-4e4e-b0c0-4a3822a61c5d tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:07:39.736066 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-c51a7921-8d5b-4e4e-b0c0-4a3822a61c5d tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:07:39.736654 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-c51a7921-8d5b-4e4e-b0c0-4a3822a61c5d tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:07:39.751978 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.wsgi [None req-c51a7921-8d5b-4e4e-b0c0-4a3822a61c5d tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] HTTP exception thrown: Instance f4c73822-1dfa-4eed-bf02-1123b0402755 could not be found. Jun 16 23:07:39.753494 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-c51a7921-8d5b-4e4e-b0c0-4a3822a61c5d tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Request method failure captured: Jun 16 23:07:39.753494 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: request: GET /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755 HTTP/1.1 Jun 16 23:07:39.753494 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Accept: application/json Jun 16 23:07:39.753494 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Accept-Encoding: identity Jun 16 23:07:39.753494 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Connection: close Jun 16 23:07:39.753494 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Content-Length: 0 Jun 16 23:07:39.753494 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Content-Type: application/json Jun 16 23:07:39.753494 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Host: 10.222.0.17 Jun 16 23:07:39.753494 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Openstack-System-Scope: None Jun 16 23:07:39.753494 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: User-Agent: python-urllib3/1.26.9 Jun 16 23:07:39.753494 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Auth-Token: gAAAAABiq7Ybkk4rah_fv4iIT3idoyxagEJSApfLNzYq7Fra8s6MuOetujUSvchI7nZZPa3uftYuuLfFRK893xYPK0M7YIPcU59Mp2UTI5ytwc6UmxRGSLxfQa_itibxYb7ELKNBXf5r_xsHXxmPbxfkW6tU28wgKVjK4ck02G_3-DW1dXLlatw Jun 16 23:07:39.753494 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Domain-Id: None Jun 16 23:07:39.753494 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Domain-Name: None Jun 16 23:07:39.753494 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Identity-Status: Confirmed Jun 16 23:07:39.753494 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Is-Admin-Project: True Jun 16 23:07:39.753494 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Project-Domain-Id: default Jun 16 23:07:39.753494 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Project-Domain-Name: Default Jun 16 23:07:39.753494 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Project-Id: f3b1be8431b0434d8bd6abca293127d5 Jun 16 23:07:39.753494 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Project-Name: tempest-AttachVolumeTestJSON-1621945621 Jun 16 23:07:39.753494 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Role: member,reader Jun 16 23:07:39.753494 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Roles: member,reader Jun 16 23:07:39.755237 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/f3b1be8431b0434d8bd6abca293127d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_f3b1be8431b0434d8bd6abca293127d5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f3b1be8431b0434d8bd6abca293127d5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f3b1be8431b0434d8bd6abca293127d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Jun 16 23:07:39.755237 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Tenant: tempest-AttachVolumeTestJSON-1621945621 Jun 16 23:07:39.755237 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Tenant-Id: f3b1be8431b0434d8bd6abca293127d5 Jun 16 23:07:39.755237 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1621945621 Jun 16 23:07:39.755237 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-User: tempest-AttachVolumeTestJSON-1621945621-project Jun 16 23:07:39.755237 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-User-Domain-Id: default Jun 16 23:07:39.755237 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-User-Domain-Name: Default Jun 16 23:07:39.755237 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-User-Id: 6a993f5d14b64fccad723abecfcadf90 Jun 16 23:07:39.755237 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-User-Name: tempest-AttachVolumeTestJSON-1621945621-project Jun 16 23:07:39.755237 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: method: > Jun 16 23:07:39.755237 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: exception: Instance f4c73822-1dfa-4eed-bf02-1123b0402755 could not be found. Jun 16 23:07:39.755237 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: action_args: {'id': 'f4c73822-1dfa-4eed-bf02-1123b0402755'} Jun 16 23:07:39.756265 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 23:07:39.756265 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 23:07:39.756265 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 23:07:39.756265 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 23:07:39.756265 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 23:07:39.756265 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 23:07:39.756265 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 23:07:39.756265 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 23:07:39.756265 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 23:07:39.756265 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 23:07:39.756265 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4c73822-1dfa-4eed-bf02-1123b0402755 could not be found. Jun 16 23:07:39.756265 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Jun 16 23:07:39.756265 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 23:07:39.756265 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Jun 16 23:07:39.756265 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 23:07:39.756265 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 23:07:39.756265 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 23:07:39.756265 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 23:07:39.756265 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 23:07:39.756265 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 23:07:39.757469 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 23:07:39.757469 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 23:07:39.757469 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 23:07:39.757469 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 23:07:39.757469 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 23:07:39.757469 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 23:07:39.757469 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 23:07:39.757469 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4c73822-1dfa-4eed-bf02-1123b0402755 could not be found. Jun 16 23:07:39.757469 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Jun 16 23:07:39.757469 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 23:07:39.757469 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Jun 16 23:07:39.757469 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 23:07:39.757469 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 23:07:39.757469 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 23:07:39.757469 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 23:07:39.757469 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 23:07:39.757469 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4c73822-1dfa-4eed-bf02-1123b0402755 could not be found. Jun 16 23:07:39.757469 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Jun 16 23:07:39.758543 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-c51a7921-8d5b-4e4e-b0c0-4a3822a61c5d tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] Returning 404 to user: Instance f4c73822-1dfa-4eed-bf02-1123b0402755 could not be found. {{(pid=117562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 23:07:39.758543 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-c51a7921-8d5b-4e4e-b0c0-4a3822a61c5d tempest-AttachVolumeTestJSON-1621945621 tempest-AttachVolumeTestJSON-1621945621-project] 10.222.0.17 "GET /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755" status: 404 len: 111 microversion: 2.1 time: 0.032149 Jun 16 23:07:39.759366 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 484/953] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:07:39 2022] GET /compute/v2.1/servers/f4c73822-1dfa-4eed-bf02-1123b0402755 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 23:07:40.342958 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-ffe0df27-8269-4239-bf38-52fac3b8b15f tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:07:40.344672 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-ffe0df27-8269-4239-bf38-52fac3b8b15f tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] [instance: 5cfd118b-cc42-4dbe-93f1-784454892318] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:07:40.351616 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-ffe0df27-8269-4239-bf38-52fac3b8b15f tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:07:40.352384 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-ffe0df27-8269-4239-bf38-52fac3b8b15f tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:07:40.353736 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-ffe0df27-8269-4239-bf38-52fac3b8b15f tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:07:40.354375 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-ffe0df27-8269-4239-bf38-52fac3b8b15f tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:07:40.371937 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.wsgi [None req-ffe0df27-8269-4239-bf38-52fac3b8b15f tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] HTTP exception thrown: Instance 5cfd118b-cc42-4dbe-93f1-784454892318 could not be found. Jun 16 23:07:40.373565 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-ffe0df27-8269-4239-bf38-52fac3b8b15f tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Request method failure captured: Jun 16 23:07:40.373565 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: request: DELETE /compute/v2.1/servers/5cfd118b-cc42-4dbe-93f1-784454892318 HTTP/1.1 Jun 16 23:07:40.373565 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Accept: application/json Jun 16 23:07:40.373565 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Accept-Encoding: identity Jun 16 23:07:40.373565 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Connection: close Jun 16 23:07:40.373565 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Content-Length: 0 Jun 16 23:07:40.373565 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Content-Type: application/json Jun 16 23:07:40.373565 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Host: 10.222.0.17 Jun 16 23:07:40.373565 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Openstack-System-Scope: None Jun 16 23:07:40.373565 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: User-Agent: python-urllib3/1.26.9 Jun 16 23:07:40.373565 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Auth-Token: gAAAAABiq7YeRQnlz8l2GSIF0VOET6Y1W8yBB5oz1cYYpYFcfT7cYY0kIvo4O2qRVrDvagXVbkghr-k-KGb8GCGo_mbQOK1vAXciruDemULKCP_QAI9xPZafRW81TxgAIAvJEx6CPJUGbCIq4SyYsx25OB1SZXBFh8aRZWpbG6CQ65KEZvQlgIo Jun 16 23:07:40.373565 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Domain-Id: None Jun 16 23:07:40.373565 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Domain-Name: None Jun 16 23:07:40.373565 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Identity-Status: Confirmed Jun 16 23:07:40.373565 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Is-Admin-Project: True Jun 16 23:07:40.373565 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Project-Domain-Id: default Jun 16 23:07:40.373565 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Project-Domain-Name: Default Jun 16 23:07:40.373565 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Project-Id: 0526c12e8bc947209e24daf5ddfad7be Jun 16 23:07:40.373565 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Project-Name: tempest-AttachVolumeNegativeTest-1967724585 Jun 16 23:07:40.373565 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Role: member,reader Jun 16 23:07:40.373565 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Roles: member,reader Jun 16 23:07:40.375198 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/0526c12e8bc947209e24daf5ddfad7be"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_0526c12e8bc947209e24daf5ddfad7be"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0526c12e8bc947209e24daf5ddfad7be"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0526c12e8bc947209e24daf5ddfad7be"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Jun 16 23:07:40.375198 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Tenant: tempest-AttachVolumeNegativeTest-1967724585 Jun 16 23:07:40.375198 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Tenant-Id: 0526c12e8bc947209e24daf5ddfad7be Jun 16 23:07:40.375198 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1967724585 Jun 16 23:07:40.375198 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-User: tempest-AttachVolumeNegativeTest-1967724585-project Jun 16 23:07:40.375198 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-User-Domain-Id: default Jun 16 23:07:40.375198 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-User-Domain-Name: Default Jun 16 23:07:40.375198 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-User-Id: 9e3a2d16133b4af8a208682de8a7d111 Jun 16 23:07:40.375198 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-User-Name: tempest-AttachVolumeNegativeTest-1967724585-project Jun 16 23:07:40.375198 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: method: > Jun 16 23:07:40.375198 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: exception: Instance 5cfd118b-cc42-4dbe-93f1-784454892318 could not be found. Jun 16 23:07:40.375198 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: action_args: {'id': '5cfd118b-cc42-4dbe-93f1-784454892318'} Jun 16 23:07:40.376045 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 23:07:40.376045 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 23:07:40.376045 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 23:07:40.376045 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 23:07:40.376045 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 23:07:40.376045 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 23:07:40.376045 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 23:07:40.376045 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 23:07:40.376045 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 23:07:40.376045 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 23:07:40.376045 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5cfd118b-cc42-4dbe-93f1-784454892318 could not be found. Jun 16 23:07:40.376045 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 16 23:07:40.376045 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 23:07:40.376045 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 16 23:07:40.376045 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 23:07:40.376045 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 23:07:40.376045 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 23:07:40.376045 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 23:07:40.376045 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 23:07:40.376045 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 23:07:40.377309 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 23:07:40.377309 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 23:07:40.377309 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 23:07:40.377309 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 23:07:40.377309 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 23:07:40.377309 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 23:07:40.377309 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 23:07:40.377309 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 23:07:40.377309 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 23:07:40.377309 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5cfd118b-cc42-4dbe-93f1-784454892318 could not be found. Jun 16 23:07:40.377309 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 16 23:07:40.377309 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 23:07:40.377309 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 16 23:07:40.377309 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 23:07:40.377309 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 23:07:40.377309 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 23:07:40.377309 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 23:07:40.377309 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 23:07:40.377309 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5cfd118b-cc42-4dbe-93f1-784454892318 could not be found. Jun 16 23:07:40.377309 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 16 23:07:40.379402 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-ffe0df27-8269-4239-bf38-52fac3b8b15f tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Returning 404 to user: Instance 5cfd118b-cc42-4dbe-93f1-784454892318 could not be found. {{(pid=117563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 23:07:40.379402 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-ffe0df27-8269-4239-bf38-52fac3b8b15f tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] 10.222.0.17 "DELETE /compute/v2.1/servers/5cfd118b-cc42-4dbe-93f1-784454892318" status: 404 len: 111 microversion: 2.1 time: 0.036109 Jun 16 23:07:40.379402 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 470/954] 10.222.0.17 () {58 vars in 1238 bytes} [Thu Jun 16 23:07:40 2022] DELETE /compute/v2.1/servers/5cfd118b-cc42-4dbe-93f1-784454892318 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 23:07:40.385610 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-06ddf77e-f7c3-416e-8489-b523503ff623 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:07:40.386368 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-06ddf77e-f7c3-416e-8489-b523503ff623 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] [instance: 5cfd118b-cc42-4dbe-93f1-784454892318] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:07:40.393925 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-06ddf77e-f7c3-416e-8489-b523503ff623 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:07:40.395474 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-06ddf77e-f7c3-416e-8489-b523503ff623 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:07:40.396374 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-06ddf77e-f7c3-416e-8489-b523503ff623 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:07:40.396897 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-06ddf77e-f7c3-416e-8489-b523503ff623 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:07:40.413758 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.wsgi [None req-06ddf77e-f7c3-416e-8489-b523503ff623 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] HTTP exception thrown: Instance 5cfd118b-cc42-4dbe-93f1-784454892318 could not be found. Jun 16 23:07:40.415488 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-06ddf77e-f7c3-416e-8489-b523503ff623 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Request method failure captured: Jun 16 23:07:40.415488 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: request: GET /compute/v2.1/servers/5cfd118b-cc42-4dbe-93f1-784454892318 HTTP/1.1 Jun 16 23:07:40.415488 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Accept: application/json Jun 16 23:07:40.415488 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Accept-Encoding: identity Jun 16 23:07:40.415488 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Connection: close Jun 16 23:07:40.415488 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Content-Length: 0 Jun 16 23:07:40.415488 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Content-Type: application/json Jun 16 23:07:40.415488 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Host: 10.222.0.17 Jun 16 23:07:40.415488 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Openstack-System-Scope: None Jun 16 23:07:40.415488 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: User-Agent: python-urllib3/1.26.9 Jun 16 23:07:40.415488 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Auth-Token: gAAAAABiq7YeRQnlz8l2GSIF0VOET6Y1W8yBB5oz1cYYpYFcfT7cYY0kIvo4O2qRVrDvagXVbkghr-k-KGb8GCGo_mbQOK1vAXciruDemULKCP_QAI9xPZafRW81TxgAIAvJEx6CPJUGbCIq4SyYsx25OB1SZXBFh8aRZWpbG6CQ65KEZvQlgIo Jun 16 23:07:40.415488 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Domain-Id: None Jun 16 23:07:40.415488 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Domain-Name: None Jun 16 23:07:40.415488 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Identity-Status: Confirmed Jun 16 23:07:40.415488 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Is-Admin-Project: True Jun 16 23:07:40.415488 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Project-Domain-Id: default Jun 16 23:07:40.415488 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Project-Domain-Name: Default Jun 16 23:07:40.415488 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Project-Id: 0526c12e8bc947209e24daf5ddfad7be Jun 16 23:07:40.415488 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Project-Name: tempest-AttachVolumeNegativeTest-1967724585 Jun 16 23:07:40.415488 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Role: member,reader Jun 16 23:07:40.415488 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Roles: member,reader Jun 16 23:07:40.416887 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/0526c12e8bc947209e24daf5ddfad7be"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_0526c12e8bc947209e24daf5ddfad7be"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0526c12e8bc947209e24daf5ddfad7be"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0526c12e8bc947209e24daf5ddfad7be"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Jun 16 23:07:40.416887 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Tenant: tempest-AttachVolumeNegativeTest-1967724585 Jun 16 23:07:40.416887 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Tenant-Id: 0526c12e8bc947209e24daf5ddfad7be Jun 16 23:07:40.416887 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1967724585 Jun 16 23:07:40.416887 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-User: tempest-AttachVolumeNegativeTest-1967724585-project Jun 16 23:07:40.416887 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-User-Domain-Id: default Jun 16 23:07:40.416887 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-User-Domain-Name: Default Jun 16 23:07:40.416887 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-User-Id: 9e3a2d16133b4af8a208682de8a7d111 Jun 16 23:07:40.416887 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-User-Name: tempest-AttachVolumeNegativeTest-1967724585-project Jun 16 23:07:40.416887 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: method: > Jun 16 23:07:40.416887 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: exception: Instance 5cfd118b-cc42-4dbe-93f1-784454892318 could not be found. Jun 16 23:07:40.416887 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: action_args: {'id': '5cfd118b-cc42-4dbe-93f1-784454892318'} Jun 16 23:07:40.418179 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 23:07:40.418179 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 23:07:40.418179 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 23:07:40.418179 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 23:07:40.418179 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 23:07:40.418179 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 23:07:40.418179 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 23:07:40.418179 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 23:07:40.418179 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 23:07:40.418179 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 23:07:40.418179 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5cfd118b-cc42-4dbe-93f1-784454892318 could not be found. Jun 16 23:07:40.418179 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Jun 16 23:07:40.418179 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 23:07:40.418179 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Jun 16 23:07:40.418179 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 23:07:40.418179 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 23:07:40.418179 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 23:07:40.418179 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 23:07:40.418179 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 23:07:40.418179 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 23:07:40.419762 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 23:07:40.419762 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 23:07:40.419762 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 23:07:40.419762 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 23:07:40.419762 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 23:07:40.419762 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 23:07:40.419762 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 23:07:40.419762 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5cfd118b-cc42-4dbe-93f1-784454892318 could not be found. Jun 16 23:07:40.419762 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Jun 16 23:07:40.419762 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 23:07:40.419762 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Jun 16 23:07:40.419762 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 23:07:40.419762 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 23:07:40.419762 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 23:07:40.419762 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 23:07:40.419762 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 23:07:40.419762 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5cfd118b-cc42-4dbe-93f1-784454892318 could not be found. Jun 16 23:07:40.419762 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Jun 16 23:07:40.421232 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-06ddf77e-f7c3-416e-8489-b523503ff623 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] Returning 404 to user: Instance 5cfd118b-cc42-4dbe-93f1-784454892318 could not be found. {{(pid=117562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 23:07:40.421232 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-06ddf77e-f7c3-416e-8489-b523503ff623 tempest-AttachVolumeNegativeTest-1967724585 tempest-AttachVolumeNegativeTest-1967724585-project] 10.222.0.17 "GET /compute/v2.1/servers/5cfd118b-cc42-4dbe-93f1-784454892318" status: 404 len: 111 microversion: 2.1 time: 0.037046 Jun 16 23:07:40.421232 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 485/955] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:07:40 2022] GET /compute/v2.1/servers/5cfd118b-cc42-4dbe-93f1-784454892318 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 23:07:45.047902 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-2764c3c0-ac3e-48c1-bdde-1d12cf1d03b5 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:07:45.048962 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-2764c3c0-ac3e-48c1-bdde-1d12cf1d03b5 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:07:45.056229 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-2764c3c0-ac3e-48c1-bdde-1d12cf1d03b5 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:07:45.057284 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-2764c3c0-ac3e-48c1-bdde-1d12cf1d03b5 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:07:45.058092 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-2764c3c0-ac3e-48c1-bdde-1d12cf1d03b5 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:07:45.058708 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-2764c3c0-ac3e-48c1-bdde-1d12cf1d03b5 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:07:45.097384 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-2764c3c0-ac3e-48c1-bdde-1d12cf1d03b5 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "GET /compute/v2.1/servers/88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.057301 Jun 16 23:07:45.098098 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 471/956] 10.222.0.17 () {60 vars in 1342 bytes} [Thu Jun 16 23:07:45 2022] GET /compute/v2.1/servers/88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:07:45.174628 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-56670af6-ca26-488e-a7ab-49bcd78a92a6 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:07:45.175204 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-56670af6-ca26-488e-a7ab-49bcd78a92a6 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:07:45.185649 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-56670af6-ca26-488e-a7ab-49bcd78a92a6 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:07:45.187198 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-56670af6-ca26-488e-a7ab-49bcd78a92a6 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:07:45.188907 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-56670af6-ca26-488e-a7ab-49bcd78a92a6 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:07:45.189513 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-56670af6-ca26-488e-a7ab-49bcd78a92a6 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:07:45.224226 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-56670af6-ca26-488e-a7ab-49bcd78a92a6 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda] Going to try to terminate instance {{(pid=117562) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 23:07:45.317008 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-56670af6-ca26-488e-a7ab-49bcd78a92a6 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "DELETE /compute/v2.1/servers/88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda" status: 204 len: 0 microversion: 2.20 time: 0.145929 Jun 16 23:07:45.318046 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 486/957] 10.222.0.17 () {60 vars in 1279 bytes} [Thu Jun 16 23:07:45 2022] DELETE /compute/v2.1/servers/88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 16 23:07:45.326401 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-687b7055-72f6-40e3-b76e-498b3bd7b507 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:07:45.327088 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-687b7055-72f6-40e3-b76e-498b3bd7b507 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:07:45.334713 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-687b7055-72f6-40e3-b76e-498b3bd7b507 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:07:45.336165 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-687b7055-72f6-40e3-b76e-498b3bd7b507 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:07:45.339918 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-687b7055-72f6-40e3-b76e-498b3bd7b507 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:07:45.341154 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-687b7055-72f6-40e3-b76e-498b3bd7b507 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:07:45.505086 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-687b7055-72f6-40e3-b76e-498b3bd7b507 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:07:45.517938 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-687b7055-72f6-40e3-b76e-498b3bd7b507 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:07:45.521362 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-687b7055-72f6-40e3-b76e-498b3bd7b507 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:07:45.523463 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-687b7055-72f6-40e3-b76e-498b3bd7b507 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "GET /compute/v2.1/servers/88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda" status: 200 len: 1724 microversion: 2.20 time: 0.201176 Jun 16 23:07:45.524849 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 472/958] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 23:07:45 2022] GET /compute/v2.1/servers/88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda => generated 1724 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 23:07:46.087745 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-9709e357-caa7-41de-b6be-6e772b6229d7 tempest-VolumesSnapshotsTestJSON-1949786500 tempest-VolumesSnapshotsTestJSON-1949786500-project] Action: 'create', calling method: .version_select at 0x7f5313e0a430>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-79103110"}} {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 23:07:46.439614 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-9709e357-caa7-41de-b6be-6e772b6229d7 tempest-VolumesSnapshotsTestJSON-1949786500 tempest-VolumesSnapshotsTestJSON-1949786500-project] 10.222.0.17 "POST /compute/v2.1/os-volumes" status: 200 len: 343 microversion: 2.1 time: 0.596205 Jun 16 23:07:46.440966 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 487/959] 10.222.0.17 () {60 vars in 1154 bytes} [Thu Jun 16 23:07:45 2022] POST /compute/v2.1/os-volumes => generated 343 bytes in 600 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 16 23:07:46.453267 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-1b79166b-cded-4543-b935-8fe4aca37925 tempest-VolumesSnapshotsTestJSON-1949786500 tempest-VolumesSnapshotsTestJSON-1949786500-project] Calling method '.version_select at 0x7f531378c670>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:07:46.514053 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-1b79166b-cded-4543-b935-8fe4aca37925 tempest-VolumesSnapshotsTestJSON-1949786500 tempest-VolumesSnapshotsTestJSON-1949786500-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/829ff595-306d-4549-b90a-5e70655db313" status: 200 len: 343 microversion: 2.1 time: 0.065328 Jun 16 23:07:46.515279 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 473/960] 10.222.0.17 () {58 vars in 1244 bytes} [Thu Jun 16 23:07:46 2022] GET /compute/v2.1/os-volumes/829ff595-306d-4549-b90a-5e70655db313 => generated 343 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 23:07:46.543826 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-02000df1-0ab5-44d8-aa36-bf65bf8390b6 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:07:46.544142 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-02000df1-0ab5-44d8-aa36-bf65bf8390b6 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:07:46.551768 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-02000df1-0ab5-44d8-aa36-bf65bf8390b6 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:07:46.552559 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-02000df1-0ab5-44d8-aa36-bf65bf8390b6 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:07:46.553647 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-02000df1-0ab5-44d8-aa36-bf65bf8390b6 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:07:46.554263 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-02000df1-0ab5-44d8-aa36-bf65bf8390b6 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:07:46.708491 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-02000df1-0ab5-44d8-aa36-bf65bf8390b6 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:07:46.718637 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-02000df1-0ab5-44d8-aa36-bf65bf8390b6 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:07:46.720166 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-02000df1-0ab5-44d8-aa36-bf65bf8390b6 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:07:46.721823 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-02000df1-0ab5-44d8-aa36-bf65bf8390b6 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "GET /compute/v2.1/servers/88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda" status: 200 len: 1724 microversion: 2.20 time: 0.182753 Jun 16 23:07:46.722765 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 488/961] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 23:07:46 2022] GET /compute/v2.1/servers/88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda => generated 1724 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 23:07:46.821312 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-1d234d21-fc95-496f-a35b-ad29ec0d2cc2 tempest-VolumesGetTestJSON-239270785 tempest-VolumesGetTestJSON-239270785-project] Action: 'create', calling method: .version_select at 0x7f531378e9d0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-2105722103", "metadata": {"Type": "work"}}} {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 23:07:47.173389 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-1d234d21-fc95-496f-a35b-ad29ec0d2cc2 tempest-VolumesGetTestJSON-239270785 tempest-VolumesGetTestJSON-239270785-project] 10.222.0.17 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.594367 Jun 16 23:07:47.174094 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 474/962] 10.222.0.17 () {60 vars in 1155 bytes} [Thu Jun 16 23:07:46 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 596 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 16 23:07:47.185164 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-a7a5127f-2578-4e45-897d-14fee7f666f0 tempest-VolumesGetTestJSON-239270785 tempest-VolumesGetTestJSON-239270785-project] Calling method '.version_select at 0x7f5313e0adc0>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:07:47.253521 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-a7a5127f-2578-4e45-897d-14fee7f666f0 tempest-VolumesGetTestJSON-239270785 tempest-VolumesGetTestJSON-239270785-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/c988f664-46ac-4217-8d76-b93bec81c29b" status: 200 len: 353 microversion: 2.1 time: 0.072175 Jun 16 23:07:47.254134 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 489/963] 10.222.0.17 () {58 vars in 1244 bytes} [Thu Jun 16 23:07:47 2022] GET /compute/v2.1/os-volumes/c988f664-46ac-4217-8d76-b93bec81c29b => generated 353 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 23:07:47.527197 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-7b83f8bb-44c5-4242-8ef5-6e175d505a91 tempest-VolumesSnapshotsTestJSON-1949786500 tempest-VolumesSnapshotsTestJSON-1949786500-project] Calling method '.version_select at 0x7f5313611ee0>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:07:47.576426 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-7b83f8bb-44c5-4242-8ef5-6e175d505a91 tempest-VolumesSnapshotsTestJSON-1949786500 tempest-VolumesSnapshotsTestJSON-1949786500-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/829ff595-306d-4549-b90a-5e70655db313" status: 200 len: 344 microversion: 2.1 time: 0.052932 Jun 16 23:07:47.577066 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 475/964] 10.222.0.17 () {58 vars in 1244 bytes} [Thu Jun 16 23:07:47 2022] GET /compute/v2.1/os-volumes/829ff595-306d-4549-b90a-5e70655db313 => generated 344 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 23:07:47.588272 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-17a6ae51-8c5e-4570-8c37-0235dd1a62f6 tempest-VolumesSnapshotsTestJSON-1949786500 tempest-VolumesSnapshotsTestJSON-1949786500-project] Action: 'create', calling method: .version_select at 0x7f5313dd99d0>, body: {"snapshot": {"volume_id": "829ff595-306d-4549-b90a-5e70655db313", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-388057358"}} {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 23:07:47.744214 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-478bd330-4dc0-4c86-9dc6-b348644c446c tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:07:47.744933 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-478bd330-4dc0-4c86-9dc6-b348644c446c tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:07:47.768755 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-478bd330-4dc0-4c86-9dc6-b348644c446c tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:07:47.776409 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-478bd330-4dc0-4c86-9dc6-b348644c446c tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:07:47.778218 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-478bd330-4dc0-4c86-9dc6-b348644c446c tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:07:47.781310 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-478bd330-4dc0-4c86-9dc6-b348644c446c tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:07:47.786236 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-17a6ae51-8c5e-4570-8c37-0235dd1a62f6 tempest-VolumesSnapshotsTestJSON-1949786500 tempest-VolumesSnapshotsTestJSON-1949786500-project] 10.222.0.17 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.201918 Jun 16 23:07:47.791877 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 490/965] 10.222.0.17 () {60 vars in 1161 bytes} [Thu Jun 16 23:07:47 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 23:07:47.802560 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [req-8a790f76-f703-4ad3-b93c-74875c1b75e5 req-07aea756-e2c6-4d35-b581-9864391b897c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda", "name": "network-vif-deleted", "tag": "4b3b90f0-95df-4c59-9186-169416370496"}]} {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 23:07:47.813585 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [req-8a790f76-f703-4ad3-b93c-74875c1b75e5 req-07aea756-e2c6-4d35-b581-9864391b897c service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:07:47.813969 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [req-8a790f76-f703-4ad3-b93c-74875c1b75e5 req-07aea756-e2c6-4d35-b581-9864391b897c service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:07:47.826584 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.compute.server_external_events [req-8a790f76-f703-4ad3-b93c-74875c1b75e5 req-07aea756-e2c6-4d35-b581-9864391b897c service nova] Creating event network-vif-deleted:4b3b90f0-95df-4c59-9186-169416370496 for instance 88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda on hv-cinder-84623 Jun 16 23:07:47.834169 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [req-8a790f76-f703-4ad3-b93c-74875c1b75e5 req-07aea756-e2c6-4d35-b581-9864391b897c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040851 Jun 16 23:07:47.835045 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 491/966] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 23:07:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 23:07:47.841579 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-b1712a63-80ba-4412-816f-05351231efa1 tempest-VolumesSnapshotsTestJSON-1949786500 tempest-VolumesSnapshotsTestJSON-1949786500-project] Calling method '.version_select at 0x7f5313df2e50>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:07:47.875188 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-478bd330-4dc0-4c86-9dc6-b348644c446c tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:07:47.884532 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-478bd330-4dc0-4c86-9dc6-b348644c446c tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:07:47.886074 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-478bd330-4dc0-4c86-9dc6-b348644c446c tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:07:47.891651 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-478bd330-4dc0-4c86-9dc6-b348644c446c tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "GET /compute/v2.1/servers/88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda" status: 200 len: 1656 microversion: 2.20 time: 0.154812 Jun 16 23:07:47.907106 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 476/967] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 23:07:47 2022] GET /compute/v2.1/servers/88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda => generated 1656 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 23:07:47.911420 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-b1712a63-80ba-4412-816f-05351231efa1 tempest-VolumesSnapshotsTestJSON-1949786500 tempest-VolumesSnapshotsTestJSON-1949786500-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/a99908ae-a07c-4567-906e-24224b766773" status: 200 len: 286 microversion: 2.1 time: 0.074764 Jun 16 23:07:47.912142 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 492/968] 10.222.0.17 () {58 vars in 1250 bytes} [Thu Jun 16 23:07:47 2022] GET /compute/v2.1/os-snapshots/a99908ae-a07c-4567-906e-24224b766773 => generated 286 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 23:07:47.924973 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-b5c65319-8b95-4d61-a2ee-3dfd8eaf2476 tempest-VolumesSnapshotsTestJSON-1949786500 tempest-VolumesSnapshotsTestJSON-1949786500-project] Calling method '.version_select at 0x7f53137a2e50>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:07:47.959091 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-b5c65319-8b95-4d61-a2ee-3dfd8eaf2476 tempest-VolumesSnapshotsTestJSON-1949786500 tempest-VolumesSnapshotsTestJSON-1949786500-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.040355 Jun 16 23:07:47.960167 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 477/969] 10.222.0.17 () {58 vars in 1139 bytes} [Thu Jun 16 23:07:47 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 23:07:47.969776 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-005e2e20-7698-4dfd-b41b-438c592abdfe tempest-VolumesSnapshotsTestJSON-1949786500 tempest-VolumesSnapshotsTestJSON-1949786500-project] Calling method '.version_select at 0x7f5313e0adc0>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:07:48.001207 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-005e2e20-7698-4dfd-b41b-438c592abdfe tempest-VolumesSnapshotsTestJSON-1949786500 tempest-VolumesSnapshotsTestJSON-1949786500-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/a99908ae-a07c-4567-906e-24224b766773" status: 200 len: 286 microversion: 2.1 time: 0.035124 Jun 16 23:07:48.002032 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 493/970] 10.222.0.17 () {58 vars in 1250 bytes} [Thu Jun 16 23:07:47 2022] GET /compute/v2.1/os-snapshots/a99908ae-a07c-4567-906e-24224b766773 => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 23:07:48.265862 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-3136fd1a-f6f3-4889-a52a-db3431006b99 tempest-VolumesGetTestJSON-239270785 tempest-VolumesGetTestJSON-239270785-project] Calling method '.version_select at 0x7f53135e79d0>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:07:48.316454 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-3136fd1a-f6f3-4889-a52a-db3431006b99 tempest-VolumesGetTestJSON-239270785 tempest-VolumesGetTestJSON-239270785-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/c988f664-46ac-4217-8d76-b93bec81c29b" status: 200 len: 354 microversion: 2.1 time: 0.054440 Jun 16 23:07:48.317207 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 478/971] 10.222.0.17 () {58 vars in 1244 bytes} [Thu Jun 16 23:07:48 2022] GET /compute/v2.1/os-volumes/c988f664-46ac-4217-8d76-b93bec81c29b => generated 354 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 23:07:48.329876 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-687359d6-e1c2-4ed4-b0c8-a1010f1f82c4 tempest-VolumesGetTestJSON-239270785 tempest-VolumesGetTestJSON-239270785-project] Calling method '.version_select at 0x7f5313ddad30>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:07:48.383379 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-687359d6-e1c2-4ed4-b0c8-a1010f1f82c4 tempest-VolumesGetTestJSON-239270785 tempest-VolumesGetTestJSON-239270785-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/c988f664-46ac-4217-8d76-b93bec81c29b" status: 200 len: 354 microversion: 2.1 time: 0.057821 Jun 16 23:07:48.383694 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 494/972] 10.222.0.17 () {58 vars in 1244 bytes} [Thu Jun 16 23:07:48 2022] GET /compute/v2.1/os-volumes/c988f664-46ac-4217-8d76-b93bec81c29b => generated 354 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 23:07:48.400685 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-e9c620f4-5d9f-449b-b848-3c10824f0088 tempest-VolumesGetTestJSON-239270785 tempest-VolumesGetTestJSON-239270785-project] Calling method '.version_select at 0x7f53137493a0>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:07:48.464847 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-e9c620f4-5d9f-449b-b848-3c10824f0088 tempest-VolumesGetTestJSON-239270785 tempest-VolumesGetTestJSON-239270785-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/c988f664-46ac-4217-8d76-b93bec81c29b" status: 202 len: 0 microversion: 2.1 time: 0.067830 Jun 16 23:07:48.465678 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 479/973] 10.222.0.17 () {58 vars in 1247 bytes} [Thu Jun 16 23:07:48 2022] DELETE /compute/v2.1/os-volumes/c988f664-46ac-4217-8d76-b93bec81c29b => generated 0 bytes in 69 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 23:07:48.473977 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-c04184d0-d01c-4b8c-ac76-cd85c8094155 tempest-VolumesGetTestJSON-239270785 tempest-VolumesGetTestJSON-239270785-project] Calling method '.version_select at 0x7f5313e0a040>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:07:48.527070 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-c04184d0-d01c-4b8c-ac76-cd85c8094155 tempest-VolumesGetTestJSON-239270785 tempest-VolumesGetTestJSON-239270785-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/c988f664-46ac-4217-8d76-b93bec81c29b" status: 200 len: 353 microversion: 2.1 time: 0.056981 Jun 16 23:07:48.528257 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 495/974] 10.222.0.17 () {58 vars in 1244 bytes} [Thu Jun 16 23:07:48 2022] GET /compute/v2.1/os-volumes/c988f664-46ac-4217-8d76-b93bec81c29b => generated 353 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 23:07:48.909448 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-93632f18-fdcb-4a20-8a92-657b366dc32a tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:07:48.910076 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-93632f18-fdcb-4a20-8a92-657b366dc32a tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:07:48.916113 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-93632f18-fdcb-4a20-8a92-657b366dc32a tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:07:48.916562 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-93632f18-fdcb-4a20-8a92-657b366dc32a tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:07:48.917318 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-93632f18-fdcb-4a20-8a92-657b366dc32a tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:07:48.917754 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-93632f18-fdcb-4a20-8a92-657b366dc32a tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:07:48.947191 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-93632f18-fdcb-4a20-8a92-657b366dc32a tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:07:48.948419 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-93632f18-fdcb-4a20-8a92-657b366dc32a tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:07:48.948859 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.objects.instance [None req-93632f18-fdcb-4a20-8a92-657b366dc32a tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lazy-loading 'fault' on Instance uuid 88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda {{(pid=117563) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 23:07:48.987531 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-93632f18-fdcb-4a20-8a92-657b366dc32a tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:07:48.995708 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-93632f18-fdcb-4a20-8a92-657b366dc32a tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:07:48.997192 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-93632f18-fdcb-4a20-8a92-657b366dc32a tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:07:48.998321 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-93632f18-fdcb-4a20-8a92-657b366dc32a tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "GET /compute/v2.1/servers/88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda" status: 200 len: 1371 microversion: 2.20 time: 0.093251 Jun 16 23:07:48.998911 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 480/975] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 23:07:48 2022] GET /compute/v2.1/servers/88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda => generated 1371 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 23:07:49.012664 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-02668eba-1cd3-434e-b127-fe94e84ed85f tempest-VolumesSnapshotsTestJSON-1949786500 tempest-VolumesSnapshotsTestJSON-1949786500-project] Calling method '.version_select at 0x7f5313d8cf70>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:07:49.041233 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-02668eba-1cd3-434e-b127-fe94e84ed85f tempest-VolumesSnapshotsTestJSON-1949786500 tempest-VolumesSnapshotsTestJSON-1949786500-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/a99908ae-a07c-4567-906e-24224b766773" status: 200 len: 286 microversion: 2.1 time: 0.032796 Jun 16 23:07:49.041787 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 496/976] 10.222.0.17 () {58 vars in 1250 bytes} [Thu Jun 16 23:07:49 2022] GET /compute/v2.1/os-snapshots/a99908ae-a07c-4567-906e-24224b766773 => generated 286 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 23:07:49.540677 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-96f992d5-91c7-4113-b4ab-26140d45ff5b tempest-VolumesGetTestJSON-239270785 tempest-VolumesGetTestJSON-239270785-project] Calling method '.version_select at 0x7f53135f9e50>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:07:49.586043 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-96f992d5-91c7-4113-b4ab-26140d45ff5b tempest-VolumesGetTestJSON-239270785 tempest-VolumesGetTestJSON-239270785-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/c988f664-46ac-4217-8d76-b93bec81c29b" status: 200 len: 353 microversion: 2.1 time: 0.049614 Jun 16 23:07:49.586620 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 481/977] 10.222.0.17 () {58 vars in 1244 bytes} [Thu Jun 16 23:07:49 2022] GET /compute/v2.1/os-volumes/c988f664-46ac-4217-8d76-b93bec81c29b => generated 353 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 23:07:50.016755 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-c50dcb88-999f-44ac-b587-4c1e82ab2fdc tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:07:50.017479 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-c50dcb88-999f-44ac-b587-4c1e82ab2fdc tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:07:50.024073 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-c50dcb88-999f-44ac-b587-4c1e82ab2fdc tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:07:50.024523 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-c50dcb88-999f-44ac-b587-4c1e82ab2fdc tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:07:50.025278 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-c50dcb88-999f-44ac-b587-4c1e82ab2fdc tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:07:50.025716 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-c50dcb88-999f-44ac-b587-4c1e82ab2fdc tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:07:50.052997 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-1cd4e140-d88c-42b1-a1df-80b889b98a5b tempest-VolumesSnapshotsTestJSON-1949786500 tempest-VolumesSnapshotsTestJSON-1949786500-project] Calling method '.version_select at 0x7f53135253a0>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:07:50.055140 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-c50dcb88-999f-44ac-b587-4c1e82ab2fdc tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:07:50.055591 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-c50dcb88-999f-44ac-b587-4c1e82ab2fdc tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:07:50.056033 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.objects.instance [None req-c50dcb88-999f-44ac-b587-4c1e82ab2fdc tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lazy-loading 'fault' on Instance uuid 88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda {{(pid=117562) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 23:07:50.084087 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-1cd4e140-d88c-42b1-a1df-80b889b98a5b tempest-VolumesSnapshotsTestJSON-1949786500 tempest-VolumesSnapshotsTestJSON-1949786500-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/a99908ae-a07c-4567-906e-24224b766773" status: 200 len: 286 microversion: 2.1 time: 0.035156 Jun 16 23:07:50.085087 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 482/978] 10.222.0.17 () {58 vars in 1250 bytes} [Thu Jun 16 23:07:50 2022] GET /compute/v2.1/os-snapshots/a99908ae-a07c-4567-906e-24224b766773 => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 23:07:50.100894 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-c50dcb88-999f-44ac-b587-4c1e82ab2fdc tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:07:50.108776 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-c50dcb88-999f-44ac-b587-4c1e82ab2fdc tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:07:50.110254 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-c50dcb88-999f-44ac-b587-4c1e82ab2fdc tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1b1a557a3834b98a3397c41665b5dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc0acf708204e1f8f4510cdb1bbf442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:07:50.111420 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-c50dcb88-999f-44ac-b587-4c1e82ab2fdc tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "GET /compute/v2.1/servers/88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda" status: 200 len: 1371 microversion: 2.20 time: 0.098999 Jun 16 23:07:50.111967 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 497/979] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 23:07:50 2022] GET /compute/v2.1/servers/88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda => generated 1371 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 23:07:50.599421 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-60b17d8b-971d-4156-9b8e-a7ac3d8f0ecc tempest-VolumesGetTestJSON-239270785 tempest-VolumesGetTestJSON-239270785-project] Calling method '.version_select at 0x7f5313761550>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:07:50.673669 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-60b17d8b-971d-4156-9b8e-a7ac3d8f0ecc tempest-VolumesGetTestJSON-239270785 tempest-VolumesGetTestJSON-239270785-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/c988f664-46ac-4217-8d76-b93bec81c29b" status: 200 len: 353 microversion: 2.1 time: 0.078157 Jun 16 23:07:50.674313 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 483/980] 10.222.0.17 () {58 vars in 1244 bytes} [Thu Jun 16 23:07:50 2022] GET /compute/v2.1/os-volumes/c988f664-46ac-4217-8d76-b93bec81c29b => generated 353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 23:07:51.096492 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-2378e3b4-93cd-4e1a-9455-331d9b61459c tempest-VolumesSnapshotsTestJSON-1949786500 tempest-VolumesSnapshotsTestJSON-1949786500-project] Calling method '.version_select at 0x7f5313e0aaf0>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:07:51.126092 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-2378e3b4-93cd-4e1a-9455-331d9b61459c tempest-VolumesSnapshotsTestJSON-1949786500 tempest-VolumesSnapshotsTestJSON-1949786500-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/a99908ae-a07c-4567-906e-24224b766773" status: 200 len: 287 microversion: 2.1 time: 0.033312 Jun 16 23:07:51.126669 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 498/981] 10.222.0.17 () {58 vars in 1250 bytes} [Thu Jun 16 23:07:51 2022] GET /compute/v2.1/os-snapshots/a99908ae-a07c-4567-906e-24224b766773 => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 23:07:51.129485 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-32e6863b-5647-4cea-8a0d-2a7e89b44aef tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:07:51.130088 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-32e6863b-5647-4cea-8a0d-2a7e89b44aef tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:07:51.136833 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-32e6863b-5647-4cea-8a0d-2a7e89b44aef tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:07:51.136986 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-f361df68-759d-4bf6-b46b-ab602c975e0c tempest-VolumesSnapshotsTestJSON-1949786500 tempest-VolumesSnapshotsTestJSON-1949786500-project] Calling method '.version_select at 0x7f5313e26430>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:07:51.137281 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-32e6863b-5647-4cea-8a0d-2a7e89b44aef tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:07:51.138046 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-32e6863b-5647-4cea-8a0d-2a7e89b44aef tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:07:51.138485 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-32e6863b-5647-4cea-8a0d-2a7e89b44aef tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:07:51.151623 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.wsgi [None req-32e6863b-5647-4cea-8a0d-2a7e89b44aef tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] HTTP exception thrown: Instance 88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda could not be found. Jun 16 23:07:51.153172 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-32e6863b-5647-4cea-8a0d-2a7e89b44aef tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Request method failure captured: Jun 16 23:07:51.153172 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: request: GET /compute/v2.1/servers/88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda HTTP/1.1 Jun 16 23:07:51.153172 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Accept: application/json Jun 16 23:07:51.153172 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Accept-Encoding: identity Jun 16 23:07:51.153172 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Connection: close Jun 16 23:07:51.153172 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Content-Length: 0 Jun 16 23:07:51.153172 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Content-Type: application/json Jun 16 23:07:51.153172 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Host: 10.222.0.17 Jun 16 23:07:51.153172 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Openstack-System-Scope: None Jun 16 23:07:51.153172 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: User-Agent: python-urllib3/1.26.9 Jun 16 23:07:51.153172 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Auth-Token: gAAAAABiq7YkgiffNcWtxIe1f-Ym0r_NFffERJq1DAa6U7CivInFe3qIgAFqxI9XpTHPB4nvxD_hmw4DL7Hkzl06iEFyRPrqAmh_eIIzJ0mr-rBV0EZooAA5T9EpRJ9h0qd9xe0xEBWxM8y8kHq-41mybPXG0kgmM3CmX8N5E-dMI_xz415q7Zg Jun 16 23:07:51.153172 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Domain-Id: None Jun 16 23:07:51.153172 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Domain-Name: None Jun 16 23:07:51.153172 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Identity-Status: Confirmed Jun 16 23:07:51.153172 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Is-Admin-Project: True Jun 16 23:07:51.153172 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Openstack-Nova-Api-Version: 2.20 Jun 16 23:07:51.153172 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Project-Domain-Id: default Jun 16 23:07:51.153172 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Project-Domain-Name: Default Jun 16 23:07:51.153172 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Project-Id: 6fc0acf708204e1f8f4510cdb1bbf442 Jun 16 23:07:51.153172 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2045494089 Jun 16 23:07:51.153172 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Role: member,reader Jun 16 23:07:51.153172 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Roles: member,reader Jun 16 23:07:51.155167 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6fc0acf708204e1f8f4510cdb1bbf442"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6fc0acf708204e1f8f4510cdb1bbf442"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6fc0acf708204e1f8f4510cdb1bbf442"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6fc0acf708204e1f8f4510cdb1bbf442"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Jun 16 23:07:51.155167 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2045494089 Jun 16 23:07:51.155167 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Tenant-Id: 6fc0acf708204e1f8f4510cdb1bbf442 Jun 16 23:07:51.155167 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2045494089 Jun 16 23:07:51.155167 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-User: tempest-AttachVolumeShelveTestJSON-2045494089-project Jun 16 23:07:51.155167 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-User-Domain-Id: default Jun 16 23:07:51.155167 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-User-Domain-Name: Default Jun 16 23:07:51.155167 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-User-Id: a1b1a557a3834b98a3397c41665b5dc6 Jun 16 23:07:51.155167 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2045494089-project Jun 16 23:07:51.155167 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: method: > Jun 16 23:07:51.155167 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: exception: Instance 88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda could not be found. Jun 16 23:07:51.155167 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: action_args: {'id': '88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda'} Jun 16 23:07:51.155986 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 23:07:51.155986 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 23:07:51.155986 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 23:07:51.155986 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 23:07:51.155986 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 23:07:51.155986 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 23:07:51.155986 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 23:07:51.155986 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 23:07:51.155986 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 23:07:51.155986 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 23:07:51.155986 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda could not be found. Jun 16 23:07:51.155986 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 16 23:07:51.155986 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 23:07:51.155986 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 16 23:07:51.155986 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 23:07:51.155986 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 23:07:51.155986 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 23:07:51.155986 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 23:07:51.155986 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 23:07:51.155986 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 23:07:51.157225 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 23:07:51.157225 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 23:07:51.157225 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 23:07:51.157225 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 23:07:51.157225 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 23:07:51.157225 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 23:07:51.157225 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 23:07:51.157225 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda could not be found. Jun 16 23:07:51.157225 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 16 23:07:51.157225 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 23:07:51.157225 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 16 23:07:51.157225 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 23:07:51.157225 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 23:07:51.157225 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 23:07:51.157225 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 23:07:51.157225 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 23:07:51.157225 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda could not be found. Jun 16 23:07:51.157225 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 16 23:07:51.158312 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-32e6863b-5647-4cea-8a0d-2a7e89b44aef tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Returning 404 to user: Instance 88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda could not be found. {{(pid=117563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 23:07:51.158312 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-32e6863b-5647-4cea-8a0d-2a7e89b44aef tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "GET /compute/v2.1/servers/88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda" status: 404 len: 111 microversion: 2.20 time: 0.029675 Jun 16 23:07:51.158312 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 484/982] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 23:07:51 2022] GET /compute/v2.1/servers/88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jun 16 23:07:51.163649 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-57a8a852-93af-4ccb-a133-3c8d174524ce tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Calling method '.version_select at 0x7f53137a2550>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:07:51.180618 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-57a8a852-93af-4ccb-a133-3c8d174524ce tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1662971911" status: 204 len: 0 microversion: 2.20 time: 0.020646 Jun 16 23:07:51.181189 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 485/983] 10.222.0.17 () {60 vars in 1261 bytes} [Thu Jun 16 23:07:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1662971911 => generated 0 bytes in 22 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 16 23:07:51.198406 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-f361df68-759d-4bf6-b46b-ab602c975e0c tempest-VolumesSnapshotsTestJSON-1949786500 tempest-VolumesSnapshotsTestJSON-1949786500-project] 10.222.0.17 "DELETE /compute/v2.1/os-snapshots/a99908ae-a07c-4567-906e-24224b766773" status: 202 len: 0 microversion: 2.1 time: 0.064656 Jun 16 23:07:51.199076 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 499/984] 10.222.0.17 () {58 vars in 1253 bytes} [Thu Jun 16 23:07:51 2022] DELETE /compute/v2.1/os-snapshots/a99908ae-a07c-4567-906e-24224b766773 => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 23:07:51.207369 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-07a04829-ea76-491d-80e8-561960102da4 tempest-VolumesSnapshotsTestJSON-1949786500 tempest-VolumesSnapshotsTestJSON-1949786500-project] Calling method '.version_select at 0x7f53135f95e0>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:07:51.237178 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-07a04829-ea76-491d-80e8-561960102da4 tempest-VolumesSnapshotsTestJSON-1949786500 tempest-VolumesSnapshotsTestJSON-1949786500-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/a99908ae-a07c-4567-906e-24224b766773" status: 200 len: 286 microversion: 2.1 time: 0.033581 Jun 16 23:07:51.237999 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 486/985] 10.222.0.17 () {58 vars in 1250 bytes} [Thu Jun 16 23:07:51 2022] GET /compute/v2.1/os-snapshots/a99908ae-a07c-4567-906e-24224b766773 => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 23:07:51.685225 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-e6659a3e-b452-498d-86ae-6b033e1fb87a tempest-VolumesGetTestJSON-239270785 tempest-VolumesGetTestJSON-239270785-project] Calling method '.version_select at 0x7f5313e1fd30>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:07:51.715855 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.wsgi [None req-e6659a3e-b452-498d-86ae-6b033e1fb87a tempest-VolumesGetTestJSON-239270785 tempest-VolumesGetTestJSON-239270785-project] HTTP exception thrown: Volume c988f664-46ac-4217-8d76-b93bec81c29b could not be found. Jun 16 23:07:51.719242 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-e6659a3e-b452-498d-86ae-6b033e1fb87a tempest-VolumesGetTestJSON-239270785 tempest-VolumesGetTestJSON-239270785-project] Request method failure captured: Jun 16 23:07:51.719242 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: request: GET /compute/v2.1/os-volumes/c988f664-46ac-4217-8d76-b93bec81c29b HTTP/1.1 Jun 16 23:07:51.719242 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Accept: application/json Jun 16 23:07:51.719242 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Accept-Encoding: identity Jun 16 23:07:51.719242 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Connection: close Jun 16 23:07:51.719242 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Content-Length: 0 Jun 16 23:07:51.719242 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Content-Type: application/json Jun 16 23:07:51.719242 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Host: 10.222.0.17 Jun 16 23:07:51.719242 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Openstack-System-Scope: None Jun 16 23:07:51.719242 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: User-Agent: python-urllib3/1.26.9 Jun 16 23:07:51.719242 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Auth-Token: gAAAAABiq7fCLGPsl3hpOAYWdbYJ0fsITZ2VietY9BiKDxny3eEUgNJZ8MNjDagL9dAjHlevqG-j_JoSbr66nVPhmsdKNmjXvd4nYfaFNJoFBrAfSfAAcjTSOzh-d1aqxICmXk-9fZo-DR6GYAiUKThx2ivBK0PQyVjYa4VUiRYzVwmOU1L4IEM Jun 16 23:07:51.719242 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Domain-Id: None Jun 16 23:07:51.719242 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Domain-Name: None Jun 16 23:07:51.719242 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Identity-Status: Confirmed Jun 16 23:07:51.719242 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Is-Admin-Project: True Jun 16 23:07:51.719242 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Project-Domain-Id: default Jun 16 23:07:51.719242 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Project-Domain-Name: Default Jun 16 23:07:51.719242 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Project-Id: db3d6f4790e3407693f21f92a47f86c0 Jun 16 23:07:51.719242 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Project-Name: tempest-VolumesGetTestJSON-239270785 Jun 16 23:07:51.719242 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Role: member,reader Jun 16 23:07:51.719242 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Roles: member,reader Jun 16 23:07:51.720850 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/db3d6f4790e3407693f21f92a47f86c0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_db3d6f4790e3407693f21f92a47f86c0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/db3d6f4790e3407693f21f92a47f86c0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/db3d6f4790e3407693f21f92a47f86c0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Jun 16 23:07:51.720850 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Tenant: tempest-VolumesGetTestJSON-239270785 Jun 16 23:07:51.720850 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Tenant-Id: db3d6f4790e3407693f21f92a47f86c0 Jun 16 23:07:51.720850 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Tenant-Name: tempest-VolumesGetTestJSON-239270785 Jun 16 23:07:51.720850 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-User: tempest-VolumesGetTestJSON-239270785-project Jun 16 23:07:51.720850 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-User-Domain-Id: default Jun 16 23:07:51.720850 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-User-Domain-Name: Default Jun 16 23:07:51.720850 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-User-Id: ea9d7afbe2cf437fbda5d6cb2464e4dc Jun 16 23:07:51.720850 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-User-Name: tempest-VolumesGetTestJSON-239270785-project Jun 16 23:07:51.720850 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: method: Jun 16 23:07:51.720850 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: exception: Volume c988f664-46ac-4217-8d76-b93bec81c29b could not be found. Jun 16 23:07:51.720850 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: action_args: {'id': 'c988f664-46ac-4217-8d76-b93bec81c29b'} Jun 16 23:07:51.720850 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 23:07:51.721828 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 23:07:51.721828 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 23:07:51.721828 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 23:07:51.721828 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 16 23:07:51.721828 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 16 23:07:51.721828 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 16 23:07:51.721828 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 16 23:07:51.721828 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 23:07:51.721828 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 23:07:51.721828 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 23:07:51.721828 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 23:07:51.721828 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 23:07:51.721828 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 23:07:51.721828 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 23:07:51.721828 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 23:07:51.721828 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c988f664-46ac-4217-8d76-b93bec81c29b could not be found. (HTTP 404) (Request-ID: req-3ed6c0d9-6626-47d0-a6c5-cc41492672c3) Jun 16 23:07:51.721828 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Jun 16 23:07:51.721828 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 23:07:51.721828 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Jun 16 23:07:51.723268 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 23:07:51.723268 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 16 23:07:51.723268 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 16 23:07:51.723268 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 16 23:07:51.723268 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 16 23:07:51.723268 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 16 23:07:51.723268 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 16 23:07:51.723268 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 16 23:07:51.723268 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 16 23:07:51.723268 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 23:07:51.723268 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 23:07:51.723268 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 16 23:07:51.723268 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 16 23:07:51.723268 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 16 23:07:51.723268 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 16 23:07:51.723268 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 23:07:51.723268 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 23:07:51.723268 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 23:07:51.723268 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 23:07:51.724616 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 23:07:51.724616 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 23:07:51.724616 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 23:07:51.724616 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 23:07:51.724616 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c988f664-46ac-4217-8d76-b93bec81c29b could not be found. Jun 16 23:07:51.724616 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Jun 16 23:07:51.724616 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 23:07:51.724616 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Jun 16 23:07:51.724616 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 23:07:51.724616 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 23:07:51.724616 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 23:07:51.724616 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 23:07:51.724616 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 23:07:51.724616 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 23:07:51.724616 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 23:07:51.724616 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 23:07:51.724616 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 23:07:51.724616 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 16 23:07:51.724616 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 23:07:51.725976 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c988f664-46ac-4217-8d76-b93bec81c29b could not be found. Jun 16 23:07:51.725976 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Jun 16 23:07:51.725976 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 23:07:51.725976 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Jun 16 23:07:51.725976 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 23:07:51.725976 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 23:07:51.725976 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 23:07:51.725976 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 23:07:51.725976 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 23:07:51.725976 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c988f664-46ac-4217-8d76-b93bec81c29b could not be found. Jun 16 23:07:51.725976 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Jun 16 23:07:51.727506 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-e6659a3e-b452-498d-86ae-6b033e1fb87a tempest-VolumesGetTestJSON-239270785 tempest-VolumesGetTestJSON-239270785-project] Returning 404 to user: Volume c988f664-46ac-4217-8d76-b93bec81c29b could not be found. {{(pid=117562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 23:07:51.728349 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-e6659a3e-b452-498d-86ae-6b033e1fb87a tempest-VolumesGetTestJSON-239270785 tempest-VolumesGetTestJSON-239270785-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/c988f664-46ac-4217-8d76-b93bec81c29b" status: 404 len: 109 microversion: 2.1 time: 0.047019 Jun 16 23:07:51.728898 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 500/986] 10.222.0.17 () {58 vars in 1244 bytes} [Thu Jun 16 23:07:51 2022] GET /compute/v2.1/os-volumes/c988f664-46ac-4217-8d76-b93bec81c29b => generated 109 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 23:07:52.249521 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-9a861817-2bbd-4d47-876c-f6bb9288036d tempest-VolumesSnapshotsTestJSON-1949786500 tempest-VolumesSnapshotsTestJSON-1949786500-project] Calling method '.version_select at 0x7f5320035940>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:07:52.282628 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.wsgi [None req-9a861817-2bbd-4d47-876c-f6bb9288036d tempest-VolumesSnapshotsTestJSON-1949786500 tempest-VolumesSnapshotsTestJSON-1949786500-project] HTTP exception thrown: Snapshot a99908ae-a07c-4567-906e-24224b766773 could not be found. Jun 16 23:07:52.285803 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-9a861817-2bbd-4d47-876c-f6bb9288036d tempest-VolumesSnapshotsTestJSON-1949786500 tempest-VolumesSnapshotsTestJSON-1949786500-project] Request method failure captured: Jun 16 23:07:52.285803 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: request: GET /compute/v2.1/os-snapshots/a99908ae-a07c-4567-906e-24224b766773 HTTP/1.1 Jun 16 23:07:52.285803 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Accept: application/json Jun 16 23:07:52.285803 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Accept-Encoding: identity Jun 16 23:07:52.285803 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Connection: close Jun 16 23:07:52.285803 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Content-Length: 0 Jun 16 23:07:52.285803 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Content-Type: application/json Jun 16 23:07:52.285803 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Host: 10.222.0.17 Jun 16 23:07:52.285803 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Openstack-System-Scope: None Jun 16 23:07:52.285803 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: User-Agent: python-urllib3/1.26.9 Jun 16 23:07:52.285803 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Auth-Token: gAAAAABiq7fB_ea92aWrW6fzCtmW-23J_TAGGX6MksqLqIdTDn3taooKhG7uYk9mdh2hzR7LtEgW1dt1FOWZNaKbM_JlTCosBJd_kwDGB0BPZLeCwdBnxbIjwGteI0JQgROp2gyMCcpimNGQFOFkA4mIImlB1vJwp6ZOsA_nE-zuzs4HP5lbyYU Jun 16 23:07:52.285803 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Domain-Id: None Jun 16 23:07:52.285803 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Domain-Name: None Jun 16 23:07:52.285803 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Identity-Status: Confirmed Jun 16 23:07:52.285803 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Is-Admin-Project: True Jun 16 23:07:52.285803 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Project-Domain-Id: default Jun 16 23:07:52.285803 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Project-Domain-Name: Default Jun 16 23:07:52.285803 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Project-Id: eb2bd01b77f948ceb4ac08cc658d39fb Jun 16 23:07:52.285803 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1949786500 Jun 16 23:07:52.285803 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Role: member,reader Jun 16 23:07:52.285803 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Roles: member,reader Jun 16 23:07:52.287467 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/eb2bd01b77f948ceb4ac08cc658d39fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_eb2bd01b77f948ceb4ac08cc658d39fb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/eb2bd01b77f948ceb4ac08cc658d39fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/eb2bd01b77f948ceb4ac08cc658d39fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Jun 16 23:07:52.287467 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1949786500 Jun 16 23:07:52.287467 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Tenant-Id: eb2bd01b77f948ceb4ac08cc658d39fb Jun 16 23:07:52.287467 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1949786500 Jun 16 23:07:52.287467 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-User: tempest-VolumesSnapshotsTestJSON-1949786500-project Jun 16 23:07:52.287467 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-User-Domain-Id: default Jun 16 23:07:52.287467 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-User-Domain-Name: Default Jun 16 23:07:52.287467 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-User-Id: 19d1751261ee4972add64c8e71a6bc47 Jun 16 23:07:52.287467 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1949786500-project Jun 16 23:07:52.287467 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: method: Jun 16 23:07:52.287467 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: exception: Snapshot a99908ae-a07c-4567-906e-24224b766773 could not be found. Jun 16 23:07:52.287467 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: action_args: {'id': 'a99908ae-a07c-4567-906e-24224b766773'} Jun 16 23:07:52.287467 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 23:07:52.288593 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 23:07:52.288593 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 16 23:07:52.288593 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 16 23:07:52.288593 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 16 23:07:52.288593 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 16 23:07:52.288593 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 16 23:07:52.288593 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 16 23:07:52.288593 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 23:07:52.288593 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 23:07:52.288593 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 23:07:52.288593 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 23:07:52.288593 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 23:07:52.288593 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 23:07:52.288593 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 23:07:52.288593 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 23:07:52.288593 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot a99908ae-a07c-4567-906e-24224b766773 could not be found. (HTTP 404) (Request-ID: req-5d763af7-b0d1-4343-93ff-486fc821b823) Jun 16 23:07:52.288593 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 16 23:07:52.288593 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 23:07:52.289884 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 16 23:07:52.289884 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 23:07:52.289884 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jun 16 23:07:52.289884 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jun 16 23:07:52.289884 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 16 23:07:52.289884 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 16 23:07:52.289884 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jun 16 23:07:52.289884 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jun 16 23:07:52.289884 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 16 23:07:52.289884 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 16 23:07:52.289884 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 16 23:07:52.289884 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 16 23:07:52.289884 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 16 23:07:52.289884 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 16 23:07:52.289884 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 16 23:07:52.289884 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 16 23:07:52.289884 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 23:07:52.289884 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 23:07:52.289884 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 23:07:52.291423 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 23:07:52.291423 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 23:07:52.291423 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 23:07:52.291423 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 23:07:52.291423 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 23:07:52.291423 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot a99908ae-a07c-4567-906e-24224b766773 could not be found. Jun 16 23:07:52.291423 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 16 23:07:52.291423 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 23:07:52.291423 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 16 23:07:52.291423 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 23:07:52.291423 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 23:07:52.291423 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 23:07:52.291423 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 23:07:52.291423 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 23:07:52.291423 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 23:07:52.291423 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 23:07:52.291423 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 23:07:52.291423 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 23:07:52.291423 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jun 16 23:07:52.291423 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 23:07:52.292778 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot a99908ae-a07c-4567-906e-24224b766773 could not be found. Jun 16 23:07:52.292778 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 16 23:07:52.292778 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 23:07:52.292778 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 16 23:07:52.292778 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 23:07:52.292778 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 23:07:52.292778 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 23:07:52.292778 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 23:07:52.292778 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 23:07:52.292778 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot a99908ae-a07c-4567-906e-24224b766773 could not be found. Jun 16 23:07:52.292778 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 16 23:07:52.292778 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-9a861817-2bbd-4d47-876c-f6bb9288036d tempest-VolumesSnapshotsTestJSON-1949786500 tempest-VolumesSnapshotsTestJSON-1949786500-project] Returning 404 to user: Snapshot a99908ae-a07c-4567-906e-24224b766773 could not be found. {{(pid=117563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 23:07:52.292778 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-9a861817-2bbd-4d47-876c-f6bb9288036d tempest-VolumesSnapshotsTestJSON-1949786500 tempest-VolumesSnapshotsTestJSON-1949786500-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/a99908ae-a07c-4567-906e-24224b766773" status: 404 len: 111 microversion: 2.1 time: 0.042061 Jun 16 23:07:52.293739 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 487/987] 10.222.0.17 () {58 vars in 1250 bytes} [Thu Jun 16 23:07:52 2022] GET /compute/v2.1/os-snapshots/a99908ae-a07c-4567-906e-24224b766773 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 23:07:52.295918 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-f106f648-1962-4787-9647-aa80ae7cf0d9 tempest-VolumesSnapshotsTestJSON-1949786500 tempest-VolumesSnapshotsTestJSON-1949786500-project] Calling method '.version_select at 0x7f5313d8c9d0>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:07:52.356154 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-f106f648-1962-4787-9647-aa80ae7cf0d9 tempest-VolumesSnapshotsTestJSON-1949786500 tempest-VolumesSnapshotsTestJSON-1949786500-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/829ff595-306d-4549-b90a-5e70655db313" status: 202 len: 0 microversion: 2.1 time: 0.063818 Jun 16 23:07:52.356748 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 501/988] 10.222.0.17 () {58 vars in 1247 bytes} [Thu Jun 16 23:07:52 2022] DELETE /compute/v2.1/os-volumes/829ff595-306d-4549-b90a-5e70655db313 => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 23:07:52.365131 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-924d9c56-f3dc-4a66-bfb2-61b7f0b51091 tempest-VolumesSnapshotsTestJSON-1949786500 tempest-VolumesSnapshotsTestJSON-1949786500-project] Calling method '.version_select at 0x7f53135c7160>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:07:52.424426 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-924d9c56-f3dc-4a66-bfb2-61b7f0b51091 tempest-VolumesSnapshotsTestJSON-1949786500 tempest-VolumesSnapshotsTestJSON-1949786500-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/829ff595-306d-4549-b90a-5e70655db313" status: 200 len: 343 microversion: 2.1 time: 0.063051 Jun 16 23:07:52.425449 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 488/989] 10.222.0.17 () {58 vars in 1244 bytes} [Thu Jun 16 23:07:52 2022] GET /compute/v2.1/os-volumes/829ff595-306d-4549-b90a-5e70655db313 => generated 343 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 23:07:52.951288 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-fd5c2e03-2bd7-4360-923a-c6a99aa0d8a6 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:07:52.951867 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-fd5c2e03-2bd7-4360-923a-c6a99aa0d8a6 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:07:52.958513 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-fd5c2e03-2bd7-4360-923a-c6a99aa0d8a6 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:07:52.959003 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-fd5c2e03-2bd7-4360-923a-c6a99aa0d8a6 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:07:52.959779 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-fd5c2e03-2bd7-4360-923a-c6a99aa0d8a6 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:07:52.960216 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-fd5c2e03-2bd7-4360-923a-c6a99aa0d8a6 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:07:52.973268 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.wsgi [None req-fd5c2e03-2bd7-4360-923a-c6a99aa0d8a6 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] HTTP exception thrown: Instance 88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda could not be found. Jun 16 23:07:52.974886 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-fd5c2e03-2bd7-4360-923a-c6a99aa0d8a6 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Request method failure captured: Jun 16 23:07:52.974886 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: request: DELETE /compute/v2.1/servers/88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda HTTP/1.1 Jun 16 23:07:52.974886 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Accept: application/json Jun 16 23:07:52.974886 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Accept-Encoding: identity Jun 16 23:07:52.974886 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Connection: close Jun 16 23:07:52.974886 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Content-Length: 0 Jun 16 23:07:52.974886 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Content-Type: application/json Jun 16 23:07:52.974886 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Host: 10.222.0.17 Jun 16 23:07:52.974886 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Openstack-System-Scope: None Jun 16 23:07:52.974886 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: User-Agent: python-urllib3/1.26.9 Jun 16 23:07:52.974886 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Auth-Token: gAAAAABiq7YkgiffNcWtxIe1f-Ym0r_NFffERJq1DAa6U7CivInFe3qIgAFqxI9XpTHPB4nvxD_hmw4DL7Hkzl06iEFyRPrqAmh_eIIzJ0mr-rBV0EZooAA5T9EpRJ9h0qd9xe0xEBWxM8y8kHq-41mybPXG0kgmM3CmX8N5E-dMI_xz415q7Zg Jun 16 23:07:52.974886 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Domain-Id: None Jun 16 23:07:52.974886 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Domain-Name: None Jun 16 23:07:52.974886 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Identity-Status: Confirmed Jun 16 23:07:52.974886 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Is-Admin-Project: True Jun 16 23:07:52.974886 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Openstack-Nova-Api-Version: 2.20 Jun 16 23:07:52.974886 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Project-Domain-Id: default Jun 16 23:07:52.974886 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Project-Domain-Name: Default Jun 16 23:07:52.974886 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Project-Id: 6fc0acf708204e1f8f4510cdb1bbf442 Jun 16 23:07:52.974886 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2045494089 Jun 16 23:07:52.974886 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Role: member,reader Jun 16 23:07:52.974886 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Roles: member,reader Jun 16 23:07:52.976683 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6fc0acf708204e1f8f4510cdb1bbf442"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6fc0acf708204e1f8f4510cdb1bbf442"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6fc0acf708204e1f8f4510cdb1bbf442"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6fc0acf708204e1f8f4510cdb1bbf442"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Jun 16 23:07:52.976683 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2045494089 Jun 16 23:07:52.976683 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Tenant-Id: 6fc0acf708204e1f8f4510cdb1bbf442 Jun 16 23:07:52.976683 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2045494089 Jun 16 23:07:52.976683 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-User: tempest-AttachVolumeShelveTestJSON-2045494089-project Jun 16 23:07:52.976683 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-User-Domain-Id: default Jun 16 23:07:52.976683 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-User-Domain-Name: Default Jun 16 23:07:52.976683 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-User-Id: a1b1a557a3834b98a3397c41665b5dc6 Jun 16 23:07:52.976683 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2045494089-project Jun 16 23:07:52.976683 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: method: > Jun 16 23:07:52.976683 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: exception: Instance 88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda could not be found. Jun 16 23:07:52.976683 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: action_args: {'id': '88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda'} Jun 16 23:07:52.977653 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 23:07:52.977653 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 23:07:52.977653 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 23:07:52.977653 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 23:07:52.977653 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 23:07:52.977653 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 23:07:52.977653 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 23:07:52.977653 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 23:07:52.977653 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 23:07:52.977653 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 23:07:52.977653 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda could not be found. Jun 16 23:07:52.977653 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Jun 16 23:07:52.977653 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 23:07:52.977653 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Jun 16 23:07:52.977653 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 23:07:52.977653 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 23:07:52.977653 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 23:07:52.977653 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 23:07:52.977653 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 23:07:52.977653 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 23:07:52.979613 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 23:07:52.979613 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 23:07:52.979613 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 23:07:52.979613 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 23:07:52.979613 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 23:07:52.979613 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 23:07:52.979613 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 23:07:52.979613 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 23:07:52.979613 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 23:07:52.979613 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda could not be found. Jun 16 23:07:52.979613 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Jun 16 23:07:52.979613 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 23:07:52.979613 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Jun 16 23:07:52.979613 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 23:07:52.979613 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 23:07:52.979613 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 23:07:52.979613 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 23:07:52.979613 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 23:07:52.979613 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda could not be found. Jun 16 23:07:52.979613 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Jun 16 23:07:52.981173 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-fd5c2e03-2bd7-4360-923a-c6a99aa0d8a6 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Returning 404 to user: Instance 88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda could not be found. {{(pid=117562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 23:07:52.981173 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-fd5c2e03-2bd7-4360-923a-c6a99aa0d8a6 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "DELETE /compute/v2.1/servers/88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda" status: 404 len: 111 microversion: 2.20 time: 0.029667 Jun 16 23:07:52.981173 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 502/990] 10.222.0.17 () {60 vars in 1279 bytes} [Thu Jun 16 23:07:52 2022] DELETE /compute/v2.1/servers/88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 16 23:07:52.986134 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-6ec80a46-bfe0-4ea6-9607-a07ced547352 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:07:52.986852 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-6ec80a46-bfe0-4ea6-9607-a07ced547352 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:07:52.993577 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-6ec80a46-bfe0-4ea6-9607-a07ced547352 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:07:52.994614 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-6ec80a46-bfe0-4ea6-9607-a07ced547352 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:07:52.995525 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-6ec80a46-bfe0-4ea6-9607-a07ced547352 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:07:52.995960 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-6ec80a46-bfe0-4ea6-9607-a07ced547352 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:07:53.008600 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.wsgi [None req-6ec80a46-bfe0-4ea6-9607-a07ced547352 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] HTTP exception thrown: Instance 88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda could not be found. Jun 16 23:07:53.010116 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-6ec80a46-bfe0-4ea6-9607-a07ced547352 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Request method failure captured: Jun 16 23:07:53.010116 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: request: GET /compute/v2.1/servers/88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda HTTP/1.1 Jun 16 23:07:53.010116 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Accept: application/json Jun 16 23:07:53.010116 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Accept-Encoding: identity Jun 16 23:07:53.010116 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Connection: close Jun 16 23:07:53.010116 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Content-Length: 0 Jun 16 23:07:53.010116 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Content-Type: application/json Jun 16 23:07:53.010116 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Host: 10.222.0.17 Jun 16 23:07:53.010116 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Openstack-System-Scope: None Jun 16 23:07:53.010116 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: User-Agent: python-urllib3/1.26.9 Jun 16 23:07:53.010116 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Auth-Token: gAAAAABiq7YkgiffNcWtxIe1f-Ym0r_NFffERJq1DAa6U7CivInFe3qIgAFqxI9XpTHPB4nvxD_hmw4DL7Hkzl06iEFyRPrqAmh_eIIzJ0mr-rBV0EZooAA5T9EpRJ9h0qd9xe0xEBWxM8y8kHq-41mybPXG0kgmM3CmX8N5E-dMI_xz415q7Zg Jun 16 23:07:53.010116 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Domain-Id: None Jun 16 23:07:53.010116 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Domain-Name: None Jun 16 23:07:53.010116 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Identity-Status: Confirmed Jun 16 23:07:53.010116 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Is-Admin-Project: True Jun 16 23:07:53.010116 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Openstack-Nova-Api-Version: 2.20 Jun 16 23:07:53.010116 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Project-Domain-Id: default Jun 16 23:07:53.010116 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Project-Domain-Name: Default Jun 16 23:07:53.010116 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Project-Id: 6fc0acf708204e1f8f4510cdb1bbf442 Jun 16 23:07:53.010116 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2045494089 Jun 16 23:07:53.010116 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Role: member,reader Jun 16 23:07:53.010116 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Roles: member,reader Jun 16 23:07:53.011752 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6fc0acf708204e1f8f4510cdb1bbf442"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6fc0acf708204e1f8f4510cdb1bbf442"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6fc0acf708204e1f8f4510cdb1bbf442"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6fc0acf708204e1f8f4510cdb1bbf442"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Jun 16 23:07:53.011752 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2045494089 Jun 16 23:07:53.011752 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Tenant-Id: 6fc0acf708204e1f8f4510cdb1bbf442 Jun 16 23:07:53.011752 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2045494089 Jun 16 23:07:53.011752 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-User: tempest-AttachVolumeShelveTestJSON-2045494089-project Jun 16 23:07:53.011752 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-User-Domain-Id: default Jun 16 23:07:53.011752 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-User-Domain-Name: Default Jun 16 23:07:53.011752 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-User-Id: a1b1a557a3834b98a3397c41665b5dc6 Jun 16 23:07:53.011752 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2045494089-project Jun 16 23:07:53.011752 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: method: > Jun 16 23:07:53.011752 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: exception: Instance 88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda could not be found. Jun 16 23:07:53.011752 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: action_args: {'id': '88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda'} Jun 16 23:07:53.015621 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 23:07:53.015621 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 23:07:53.015621 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 23:07:53.015621 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 23:07:53.015621 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 23:07:53.015621 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 23:07:53.015621 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 23:07:53.015621 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 23:07:53.015621 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 23:07:53.015621 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 23:07:53.015621 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda could not be found. Jun 16 23:07:53.015621 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 16 23:07:53.015621 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 23:07:53.015621 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 16 23:07:53.015621 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 23:07:53.015621 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 23:07:53.015621 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 23:07:53.015621 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 23:07:53.015621 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 23:07:53.015621 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 23:07:53.017129 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 23:07:53.017129 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 23:07:53.017129 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 23:07:53.017129 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 23:07:53.017129 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 23:07:53.017129 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 23:07:53.017129 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 23:07:53.017129 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda could not be found. Jun 16 23:07:53.017129 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 16 23:07:53.017129 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 23:07:53.017129 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 16 23:07:53.017129 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 23:07:53.017129 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 23:07:53.017129 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 23:07:53.017129 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 23:07:53.017129 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 23:07:53.017129 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda could not be found. Jun 16 23:07:53.017129 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 16 23:07:53.018438 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-6ec80a46-bfe0-4ea6-9607-a07ced547352 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Returning 404 to user: Instance 88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda could not be found. {{(pid=117563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 23:07:53.018438 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-6ec80a46-bfe0-4ea6-9607-a07ced547352 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "GET /compute/v2.1/servers/88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda" status: 404 len: 111 microversion: 2.20 time: 0.029183 Jun 16 23:07:53.018438 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 489/991] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 23:07:52 2022] GET /compute/v2.1/servers/88cf5f83-6cf4-4b7a-8b9d-7c890f5cfdda => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 16 23:07:53.438259 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-e72e6517-5668-4fef-bd82-424c6a278492 tempest-VolumesSnapshotsTestJSON-1949786500 tempest-VolumesSnapshotsTestJSON-1949786500-project] Calling method '.version_select at 0x7f5313e71ca0>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:07:53.474047 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.wsgi [None req-e72e6517-5668-4fef-bd82-424c6a278492 tempest-VolumesSnapshotsTestJSON-1949786500 tempest-VolumesSnapshotsTestJSON-1949786500-project] HTTP exception thrown: Volume 829ff595-306d-4549-b90a-5e70655db313 could not be found. Jun 16 23:07:53.476089 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-e72e6517-5668-4fef-bd82-424c6a278492 tempest-VolumesSnapshotsTestJSON-1949786500 tempest-VolumesSnapshotsTestJSON-1949786500-project] Request method failure captured: Jun 16 23:07:53.476089 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: request: GET /compute/v2.1/os-volumes/829ff595-306d-4549-b90a-5e70655db313 HTTP/1.1 Jun 16 23:07:53.476089 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Accept: application/json Jun 16 23:07:53.476089 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Accept-Encoding: identity Jun 16 23:07:53.476089 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Connection: close Jun 16 23:07:53.476089 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Content-Length: 0 Jun 16 23:07:53.476089 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Content-Type: application/json Jun 16 23:07:53.476089 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Host: 10.222.0.17 Jun 16 23:07:53.476089 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Openstack-System-Scope: None Jun 16 23:07:53.476089 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: User-Agent: python-urllib3/1.26.9 Jun 16 23:07:53.476089 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Auth-Token: gAAAAABiq7fB_ea92aWrW6fzCtmW-23J_TAGGX6MksqLqIdTDn3taooKhG7uYk9mdh2hzR7LtEgW1dt1FOWZNaKbM_JlTCosBJd_kwDGB0BPZLeCwdBnxbIjwGteI0JQgROp2gyMCcpimNGQFOFkA4mIImlB1vJwp6ZOsA_nE-zuzs4HP5lbyYU Jun 16 23:07:53.476089 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Domain-Id: None Jun 16 23:07:53.476089 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Domain-Name: None Jun 16 23:07:53.476089 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Identity-Status: Confirmed Jun 16 23:07:53.476089 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Is-Admin-Project: True Jun 16 23:07:53.476089 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Project-Domain-Id: default Jun 16 23:07:53.476089 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Project-Domain-Name: Default Jun 16 23:07:53.476089 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Project-Id: eb2bd01b77f948ceb4ac08cc658d39fb Jun 16 23:07:53.476089 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1949786500 Jun 16 23:07:53.476089 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Role: member,reader Jun 16 23:07:53.476089 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Roles: member,reader Jun 16 23:07:53.477658 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/eb2bd01b77f948ceb4ac08cc658d39fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_eb2bd01b77f948ceb4ac08cc658d39fb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/eb2bd01b77f948ceb4ac08cc658d39fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/eb2bd01b77f948ceb4ac08cc658d39fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Jun 16 23:07:53.477658 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1949786500 Jun 16 23:07:53.477658 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Tenant-Id: eb2bd01b77f948ceb4ac08cc658d39fb Jun 16 23:07:53.477658 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1949786500 Jun 16 23:07:53.477658 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-User: tempest-VolumesSnapshotsTestJSON-1949786500-project Jun 16 23:07:53.477658 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-User-Domain-Id: default Jun 16 23:07:53.477658 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-User-Domain-Name: Default Jun 16 23:07:53.477658 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-User-Id: 19d1751261ee4972add64c8e71a6bc47 Jun 16 23:07:53.477658 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1949786500-project Jun 16 23:07:53.477658 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: method: Jun 16 23:07:53.477658 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: exception: Volume 829ff595-306d-4549-b90a-5e70655db313 could not be found. Jun 16 23:07:53.477658 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: action_args: {'id': '829ff595-306d-4549-b90a-5e70655db313'} Jun 16 23:07:53.477658 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 23:07:53.478702 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 23:07:53.478702 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 23:07:53.478702 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 23:07:53.478702 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 16 23:07:53.478702 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 16 23:07:53.478702 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 16 23:07:53.478702 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 16 23:07:53.478702 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 23:07:53.478702 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 23:07:53.478702 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 23:07:53.478702 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 23:07:53.478702 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 23:07:53.478702 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 23:07:53.478702 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 23:07:53.478702 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 23:07:53.478702 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 829ff595-306d-4549-b90a-5e70655db313 could not be found. (HTTP 404) (Request-ID: req-4e34de6c-99a1-4596-8c89-e4afc009c471) Jun 16 23:07:53.478702 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Jun 16 23:07:53.478702 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 23:07:53.478702 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Jun 16 23:07:53.480030 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 23:07:53.480030 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 16 23:07:53.480030 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 16 23:07:53.480030 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 16 23:07:53.480030 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 16 23:07:53.480030 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 16 23:07:53.480030 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 16 23:07:53.480030 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 16 23:07:53.480030 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 16 23:07:53.480030 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 23:07:53.480030 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 23:07:53.480030 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 16 23:07:53.480030 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 16 23:07:53.480030 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 16 23:07:53.480030 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 16 23:07:53.480030 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 23:07:53.480030 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 23:07:53.480030 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 23:07:53.480030 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 23:07:53.481222 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 23:07:53.481222 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 23:07:53.481222 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 23:07:53.481222 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 23:07:53.481222 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 829ff595-306d-4549-b90a-5e70655db313 could not be found. Jun 16 23:07:53.481222 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Jun 16 23:07:53.481222 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 23:07:53.481222 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Jun 16 23:07:53.481222 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 23:07:53.481222 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 23:07:53.481222 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 23:07:53.481222 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 23:07:53.481222 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 23:07:53.481222 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 23:07:53.481222 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 23:07:53.481222 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 23:07:53.481222 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 23:07:53.481222 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 16 23:07:53.481222 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 23:07:53.482333 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 829ff595-306d-4549-b90a-5e70655db313 could not be found. Jun 16 23:07:53.482333 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Jun 16 23:07:53.482333 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 23:07:53.482333 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Jun 16 23:07:53.482333 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 23:07:53.482333 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 23:07:53.482333 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 23:07:53.482333 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 23:07:53.482333 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 23:07:53.482333 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 829ff595-306d-4549-b90a-5e70655db313 could not be found. Jun 16 23:07:53.482333 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Jun 16 23:07:53.482333 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-e72e6517-5668-4fef-bd82-424c6a278492 tempest-VolumesSnapshotsTestJSON-1949786500 tempest-VolumesSnapshotsTestJSON-1949786500-project] Returning 404 to user: Volume 829ff595-306d-4549-b90a-5e70655db313 could not be found. {{(pid=117562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 23:07:53.482333 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-e72e6517-5668-4fef-bd82-424c6a278492 tempest-VolumesSnapshotsTestJSON-1949786500 tempest-VolumesSnapshotsTestJSON-1949786500-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/829ff595-306d-4549-b90a-5e70655db313" status: 404 len: 109 microversion: 2.1 time: 0.043201 Jun 16 23:07:53.482333 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 503/992] 10.222.0.17 () {58 vars in 1244 bytes} [Thu Jun 16 23:07:53 2022] GET /compute/v2.1/os-volumes/829ff595-306d-4549-b90a-5e70655db313 => generated 109 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 23:07:53.487856 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-405b93da-b1b4-40c3-8e23-5f4c03536480 tempest-VolumesSnapshotsTestJSON-1949786500 tempest-VolumesSnapshotsTestJSON-1949786500-project] Calling method '.version_select at 0x7f5313611670>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:07:53.518877 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.wsgi [None req-405b93da-b1b4-40c3-8e23-5f4c03536480 tempest-VolumesSnapshotsTestJSON-1949786500 tempest-VolumesSnapshotsTestJSON-1949786500-project] HTTP exception thrown: Volume 829ff595-306d-4549-b90a-5e70655db313 could not be found. Jun 16 23:07:53.521186 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-405b93da-b1b4-40c3-8e23-5f4c03536480 tempest-VolumesSnapshotsTestJSON-1949786500 tempest-VolumesSnapshotsTestJSON-1949786500-project] Request method failure captured: Jun 16 23:07:53.521186 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: request: DELETE /compute/v2.1/os-volumes/829ff595-306d-4549-b90a-5e70655db313 HTTP/1.1 Jun 16 23:07:53.521186 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Accept: application/json Jun 16 23:07:53.521186 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Accept-Encoding: identity Jun 16 23:07:53.521186 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Connection: close Jun 16 23:07:53.521186 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Content-Length: 0 Jun 16 23:07:53.521186 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Content-Type: application/json Jun 16 23:07:53.521186 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Host: 10.222.0.17 Jun 16 23:07:53.521186 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Openstack-System-Scope: None Jun 16 23:07:53.521186 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: User-Agent: python-urllib3/1.26.9 Jun 16 23:07:53.521186 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Auth-Token: gAAAAABiq7fB_ea92aWrW6fzCtmW-23J_TAGGX6MksqLqIdTDn3taooKhG7uYk9mdh2hzR7LtEgW1dt1FOWZNaKbM_JlTCosBJd_kwDGB0BPZLeCwdBnxbIjwGteI0JQgROp2gyMCcpimNGQFOFkA4mIImlB1vJwp6ZOsA_nE-zuzs4HP5lbyYU Jun 16 23:07:53.521186 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Domain-Id: None Jun 16 23:07:53.521186 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Domain-Name: None Jun 16 23:07:53.521186 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Identity-Status: Confirmed Jun 16 23:07:53.521186 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Is-Admin-Project: True Jun 16 23:07:53.521186 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Project-Domain-Id: default Jun 16 23:07:53.521186 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Project-Domain-Name: Default Jun 16 23:07:53.521186 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Project-Id: eb2bd01b77f948ceb4ac08cc658d39fb Jun 16 23:07:53.521186 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1949786500 Jun 16 23:07:53.521186 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Role: member,reader Jun 16 23:07:53.521186 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Roles: member,reader Jun 16 23:07:53.522789 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/eb2bd01b77f948ceb4ac08cc658d39fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_eb2bd01b77f948ceb4ac08cc658d39fb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/eb2bd01b77f948ceb4ac08cc658d39fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/eb2bd01b77f948ceb4ac08cc658d39fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Jun 16 23:07:53.522789 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1949786500 Jun 16 23:07:53.522789 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Tenant-Id: eb2bd01b77f948ceb4ac08cc658d39fb Jun 16 23:07:53.522789 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1949786500 Jun 16 23:07:53.522789 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-User: tempest-VolumesSnapshotsTestJSON-1949786500-project Jun 16 23:07:53.522789 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-User-Domain-Id: default Jun 16 23:07:53.522789 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-User-Domain-Name: Default Jun 16 23:07:53.522789 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-User-Id: 19d1751261ee4972add64c8e71a6bc47 Jun 16 23:07:53.522789 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1949786500-project Jun 16 23:07:53.522789 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: method: Jun 16 23:07:53.522789 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: exception: Volume 829ff595-306d-4549-b90a-5e70655db313 could not be found. Jun 16 23:07:53.522789 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: action_args: {'id': '829ff595-306d-4549-b90a-5e70655db313'} Jun 16 23:07:53.522789 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 23:07:53.523802 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 23:07:53.523802 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 23:07:53.523802 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 23:07:53.523802 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 16 23:07:53.523802 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 16 23:07:53.523802 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 16 23:07:53.523802 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 16 23:07:53.523802 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 16 23:07:53.523802 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 16 23:07:53.523802 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 16 23:07:53.523802 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 16 23:07:53.523802 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 23:07:53.523802 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 23:07:53.523802 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 23:07:53.523802 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 23:07:53.523802 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 829ff595-306d-4549-b90a-5e70655db313 could not be found. (HTTP 404) (Request-ID: req-bfd4b5fe-5d81-4ed8-ba0a-68f80fc55369) Jun 16 23:07:53.523802 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 16 23:07:53.523802 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 23:07:53.523802 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 16 23:07:53.525181 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 23:07:53.525181 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 16 23:07:53.525181 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 16 23:07:53.525181 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 16 23:07:53.525181 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 16 23:07:53.525181 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 16 23:07:53.525181 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 16 23:07:53.525181 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 16 23:07:53.525181 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 16 23:07:53.525181 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 23:07:53.525181 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 23:07:53.525181 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 16 23:07:53.525181 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 16 23:07:53.525181 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 16 23:07:53.525181 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 16 23:07:53.525181 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 16 23:07:53.525181 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 16 23:07:53.525181 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 16 23:07:53.525181 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 16 23:07:53.526648 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 23:07:53.526648 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 23:07:53.526648 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 23:07:53.526648 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 23:07:53.526648 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 829ff595-306d-4549-b90a-5e70655db313 could not be found. Jun 16 23:07:53.526648 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 16 23:07:53.526648 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 23:07:53.526648 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 16 23:07:53.526648 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 23:07:53.526648 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 23:07:53.526648 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 23:07:53.526648 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 23:07:53.526648 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 23:07:53.526648 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 23:07:53.526648 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 23:07:53.526648 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 23:07:53.526648 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 23:07:53.526648 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 16 23:07:53.526648 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 23:07:53.528009 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 829ff595-306d-4549-b90a-5e70655db313 could not be found. Jun 16 23:07:53.528009 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 16 23:07:53.528009 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 23:07:53.528009 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 16 23:07:53.528009 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 23:07:53.528009 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 23:07:53.528009 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 23:07:53.528009 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 23:07:53.528009 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 23:07:53.528009 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 829ff595-306d-4549-b90a-5e70655db313 could not be found. Jun 16 23:07:53.528009 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 16 23:07:53.528009 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-405b93da-b1b4-40c3-8e23-5f4c03536480 tempest-VolumesSnapshotsTestJSON-1949786500 tempest-VolumesSnapshotsTestJSON-1949786500-project] Returning 404 to user: Volume 829ff595-306d-4549-b90a-5e70655db313 could not be found. {{(pid=117563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 23:07:53.528009 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-405b93da-b1b4-40c3-8e23-5f4c03536480 tempest-VolumesSnapshotsTestJSON-1949786500 tempest-VolumesSnapshotsTestJSON-1949786500-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/829ff595-306d-4549-b90a-5e70655db313" status: 404 len: 109 microversion: 2.1 time: 0.039310 Jun 16 23:07:53.528009 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 490/993] 10.222.0.17 () {58 vars in 1247 bytes} [Thu Jun 16 23:07:53 2022] DELETE /compute/v2.1/os-volumes/829ff595-306d-4549-b90a-5e70655db313 => generated 109 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 23:07:53.534566 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-30dd29fd-94de-48da-89c9-de010625437a tempest-VolumesSnapshotsTestJSON-1949786500 tempest-VolumesSnapshotsTestJSON-1949786500-project] Calling method '.version_select at 0x7f5313d8c9d0>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:07:53.564082 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.wsgi [None req-30dd29fd-94de-48da-89c9-de010625437a tempest-VolumesSnapshotsTestJSON-1949786500 tempest-VolumesSnapshotsTestJSON-1949786500-project] HTTP exception thrown: Volume 829ff595-306d-4549-b90a-5e70655db313 could not be found. Jun 16 23:07:53.566026 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-30dd29fd-94de-48da-89c9-de010625437a tempest-VolumesSnapshotsTestJSON-1949786500 tempest-VolumesSnapshotsTestJSON-1949786500-project] Request method failure captured: Jun 16 23:07:53.566026 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: request: GET /compute/v2.1/os-volumes/829ff595-306d-4549-b90a-5e70655db313 HTTP/1.1 Jun 16 23:07:53.566026 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Accept: application/json Jun 16 23:07:53.566026 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Accept-Encoding: identity Jun 16 23:07:53.566026 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Connection: close Jun 16 23:07:53.566026 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Content-Length: 0 Jun 16 23:07:53.566026 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Content-Type: application/json Jun 16 23:07:53.566026 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Host: 10.222.0.17 Jun 16 23:07:53.566026 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Openstack-System-Scope: None Jun 16 23:07:53.566026 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: User-Agent: python-urllib3/1.26.9 Jun 16 23:07:53.566026 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Auth-Token: gAAAAABiq7fB_ea92aWrW6fzCtmW-23J_TAGGX6MksqLqIdTDn3taooKhG7uYk9mdh2hzR7LtEgW1dt1FOWZNaKbM_JlTCosBJd_kwDGB0BPZLeCwdBnxbIjwGteI0JQgROp2gyMCcpimNGQFOFkA4mIImlB1vJwp6ZOsA_nE-zuzs4HP5lbyYU Jun 16 23:07:53.566026 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Domain-Id: None Jun 16 23:07:53.566026 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Domain-Name: None Jun 16 23:07:53.566026 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Identity-Status: Confirmed Jun 16 23:07:53.566026 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Is-Admin-Project: True Jun 16 23:07:53.566026 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Project-Domain-Id: default Jun 16 23:07:53.566026 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Project-Domain-Name: Default Jun 16 23:07:53.566026 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Project-Id: eb2bd01b77f948ceb4ac08cc658d39fb Jun 16 23:07:53.566026 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1949786500 Jun 16 23:07:53.566026 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Role: member,reader Jun 16 23:07:53.566026 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Roles: member,reader Jun 16 23:07:53.567691 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/eb2bd01b77f948ceb4ac08cc658d39fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_eb2bd01b77f948ceb4ac08cc658d39fb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/eb2bd01b77f948ceb4ac08cc658d39fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/eb2bd01b77f948ceb4ac08cc658d39fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Jun 16 23:07:53.567691 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1949786500 Jun 16 23:07:53.567691 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Tenant-Id: eb2bd01b77f948ceb4ac08cc658d39fb Jun 16 23:07:53.567691 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1949786500 Jun 16 23:07:53.567691 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-User: tempest-VolumesSnapshotsTestJSON-1949786500-project Jun 16 23:07:53.567691 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-User-Domain-Id: default Jun 16 23:07:53.567691 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-User-Domain-Name: Default Jun 16 23:07:53.567691 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-User-Id: 19d1751261ee4972add64c8e71a6bc47 Jun 16 23:07:53.567691 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1949786500-project Jun 16 23:07:53.567691 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: method: Jun 16 23:07:53.567691 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: exception: Volume 829ff595-306d-4549-b90a-5e70655db313 could not be found. Jun 16 23:07:53.567691 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: action_args: {'id': '829ff595-306d-4549-b90a-5e70655db313'} Jun 16 23:07:53.567691 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 23:07:53.568607 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 23:07:53.568607 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 23:07:53.568607 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 23:07:53.568607 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 16 23:07:53.568607 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 16 23:07:53.568607 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 16 23:07:53.568607 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 16 23:07:53.568607 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 23:07:53.568607 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 23:07:53.568607 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 23:07:53.568607 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 23:07:53.568607 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 23:07:53.568607 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 23:07:53.568607 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 23:07:53.568607 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 23:07:53.568607 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 829ff595-306d-4549-b90a-5e70655db313 could not be found. (HTTP 404) (Request-ID: req-793bd5e3-c3ec-4f3a-bfa3-de525c7c8127) Jun 16 23:07:53.568607 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Jun 16 23:07:53.568607 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 23:07:53.568607 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Jun 16 23:07:53.569955 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 23:07:53.569955 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 16 23:07:53.569955 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 16 23:07:53.569955 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 16 23:07:53.569955 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 16 23:07:53.569955 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 16 23:07:53.569955 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 16 23:07:53.569955 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 16 23:07:53.569955 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 16 23:07:53.569955 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 23:07:53.569955 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 23:07:53.569955 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 16 23:07:53.569955 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 16 23:07:53.569955 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 16 23:07:53.569955 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 16 23:07:53.569955 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 23:07:53.569955 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 23:07:53.569955 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 23:07:53.569955 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 23:07:53.571303 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 23:07:53.571303 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 23:07:53.571303 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 23:07:53.571303 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 23:07:53.571303 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 829ff595-306d-4549-b90a-5e70655db313 could not be found. Jun 16 23:07:53.571303 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Jun 16 23:07:53.571303 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 23:07:53.571303 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Jun 16 23:07:53.571303 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 23:07:53.571303 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 23:07:53.571303 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 23:07:53.571303 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 23:07:53.571303 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 23:07:53.571303 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 23:07:53.571303 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 23:07:53.571303 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 23:07:53.571303 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 23:07:53.571303 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 16 23:07:53.571303 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 23:07:53.573511 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 829ff595-306d-4549-b90a-5e70655db313 could not be found. Jun 16 23:07:53.573511 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Jun 16 23:07:53.573511 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 23:07:53.573511 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Jun 16 23:07:53.573511 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 23:07:53.573511 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 23:07:53.573511 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 23:07:53.573511 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 23:07:53.573511 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 23:07:53.573511 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 829ff595-306d-4549-b90a-5e70655db313 could not be found. Jun 16 23:07:53.573511 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Jun 16 23:07:53.573511 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-30dd29fd-94de-48da-89c9-de010625437a tempest-VolumesSnapshotsTestJSON-1949786500 tempest-VolumesSnapshotsTestJSON-1949786500-project] Returning 404 to user: Volume 829ff595-306d-4549-b90a-5e70655db313 could not be found. {{(pid=117562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 23:07:53.573511 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-30dd29fd-94de-48da-89c9-de010625437a tempest-VolumesSnapshotsTestJSON-1949786500 tempest-VolumesSnapshotsTestJSON-1949786500-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/829ff595-306d-4549-b90a-5e70655db313" status: 404 len: 109 microversion: 2.1 time: 0.039686 Jun 16 23:07:53.573511 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 504/994] 10.222.0.17 () {58 vars in 1244 bytes} [Thu Jun 16 23:07:53 2022] GET /compute/v2.1/os-volumes/829ff595-306d-4549-b90a-5e70655db313 => generated 109 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 23:07:54.169866 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-1fa7a698-8625-4d33-a556-8d2955e1ed90 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:07:54.170615 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-1fa7a698-8625-4d33-a556-8d2955e1ed90 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 46f43909-d681-4938-8253-5080b626e169] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:07:54.178330 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-1fa7a698-8625-4d33-a556-8d2955e1ed90 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:07:54.178888 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-1fa7a698-8625-4d33-a556-8d2955e1ed90 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:07:54.179834 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-1fa7a698-8625-4d33-a556-8d2955e1ed90 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:07:54.180428 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-1fa7a698-8625-4d33-a556-8d2955e1ed90 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:07:54.185496 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG dbcounter [-] [117563] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 23:07:54.197800 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.wsgi [None req-1fa7a698-8625-4d33-a556-8d2955e1ed90 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] HTTP exception thrown: Instance 46f43909-d681-4938-8253-5080b626e169 could not be found. Jun 16 23:07:54.199649 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-1fa7a698-8625-4d33-a556-8d2955e1ed90 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Request method failure captured: Jun 16 23:07:54.199649 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: request: DELETE /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169 HTTP/1.1 Jun 16 23:07:54.199649 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Accept: application/json Jun 16 23:07:54.199649 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Accept-Encoding: identity Jun 16 23:07:54.199649 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Connection: close Jun 16 23:07:54.199649 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Content-Length: 0 Jun 16 23:07:54.199649 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Content-Type: application/json Jun 16 23:07:54.199649 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Host: 10.222.0.17 Jun 16 23:07:54.199649 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Openstack-System-Scope: None Jun 16 23:07:54.199649 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: User-Agent: python-urllib3/1.26.9 Jun 16 23:07:54.199649 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Auth-Token: gAAAAABiq7YkgiffNcWtxIe1f-Ym0r_NFffERJq1DAa6U7CivInFe3qIgAFqxI9XpTHPB4nvxD_hmw4DL7Hkzl06iEFyRPrqAmh_eIIzJ0mr-rBV0EZooAA5T9EpRJ9h0qd9xe0xEBWxM8y8kHq-41mybPXG0kgmM3CmX8N5E-dMI_xz415q7Zg Jun 16 23:07:54.199649 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Domain-Id: None Jun 16 23:07:54.199649 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Domain-Name: None Jun 16 23:07:54.199649 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Identity-Status: Confirmed Jun 16 23:07:54.199649 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Is-Admin-Project: True Jun 16 23:07:54.199649 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Openstack-Nova-Api-Version: 2.20 Jun 16 23:07:54.199649 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Project-Domain-Id: default Jun 16 23:07:54.199649 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Project-Domain-Name: Default Jun 16 23:07:54.199649 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Project-Id: 6fc0acf708204e1f8f4510cdb1bbf442 Jun 16 23:07:54.199649 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2045494089 Jun 16 23:07:54.199649 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Role: member,reader Jun 16 23:07:54.199649 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Roles: member,reader Jun 16 23:07:54.201219 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6fc0acf708204e1f8f4510cdb1bbf442"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6fc0acf708204e1f8f4510cdb1bbf442"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6fc0acf708204e1f8f4510cdb1bbf442"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6fc0acf708204e1f8f4510cdb1bbf442"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Jun 16 23:07:54.201219 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2045494089 Jun 16 23:07:54.201219 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Tenant-Id: 6fc0acf708204e1f8f4510cdb1bbf442 Jun 16 23:07:54.201219 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2045494089 Jun 16 23:07:54.201219 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-User: tempest-AttachVolumeShelveTestJSON-2045494089-project Jun 16 23:07:54.201219 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-User-Domain-Id: default Jun 16 23:07:54.201219 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-User-Domain-Name: Default Jun 16 23:07:54.201219 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-User-Id: a1b1a557a3834b98a3397c41665b5dc6 Jun 16 23:07:54.201219 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2045494089-project Jun 16 23:07:54.201219 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: method: > Jun 16 23:07:54.201219 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: exception: Instance 46f43909-d681-4938-8253-5080b626e169 could not be found. Jun 16 23:07:54.201219 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: action_args: {'id': '46f43909-d681-4938-8253-5080b626e169'} Jun 16 23:07:54.201975 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 23:07:54.201975 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 23:07:54.201975 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 23:07:54.201975 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 23:07:54.201975 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 23:07:54.201975 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 23:07:54.201975 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 23:07:54.201975 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 23:07:54.201975 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 23:07:54.201975 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 23:07:54.201975 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46f43909-d681-4938-8253-5080b626e169 could not be found. Jun 16 23:07:54.201975 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 16 23:07:54.201975 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 23:07:54.201975 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 16 23:07:54.201975 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 23:07:54.201975 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 23:07:54.201975 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 23:07:54.201975 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 23:07:54.201975 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 23:07:54.201975 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 23:07:54.203250 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 23:07:54.203250 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 23:07:54.203250 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 23:07:54.203250 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 23:07:54.203250 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 23:07:54.203250 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 23:07:54.203250 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 23:07:54.203250 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 23:07:54.203250 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 23:07:54.203250 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46f43909-d681-4938-8253-5080b626e169 could not be found. Jun 16 23:07:54.203250 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 16 23:07:54.203250 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 23:07:54.203250 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 16 23:07:54.203250 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 23:07:54.203250 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 23:07:54.203250 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 23:07:54.203250 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 23:07:54.203250 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 23:07:54.203250 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46f43909-d681-4938-8253-5080b626e169 could not be found. Jun 16 23:07:54.203250 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 16 23:07:54.205438 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-1fa7a698-8625-4d33-a556-8d2955e1ed90 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Returning 404 to user: Instance 46f43909-d681-4938-8253-5080b626e169 could not be found. {{(pid=117563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 23:07:54.205438 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-1fa7a698-8625-4d33-a556-8d2955e1ed90 tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "DELETE /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169" status: 404 len: 111 microversion: 2.20 time: 0.039460 Jun 16 23:07:54.205438 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 491/995] 10.222.0.17 () {60 vars in 1279 bytes} [Thu Jun 16 23:07:54 2022] DELETE /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 16 23:07:54.211154 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-8342c0ad-a1c0-44dc-89c3-38a47859cd4c tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:07:54.211154 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-8342c0ad-a1c0-44dc-89c3-38a47859cd4c tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] [instance: 46f43909-d681-4938-8253-5080b626e169] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:07:54.220788 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-8342c0ad-a1c0-44dc-89c3-38a47859cd4c tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:07:54.225537 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-8342c0ad-a1c0-44dc-89c3-38a47859cd4c tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:07:54.226947 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-8342c0ad-a1c0-44dc-89c3-38a47859cd4c tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:07:54.227425 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-8342c0ad-a1c0-44dc-89c3-38a47859cd4c tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:07:54.242734 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.wsgi [None req-8342c0ad-a1c0-44dc-89c3-38a47859cd4c tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] HTTP exception thrown: Instance 46f43909-d681-4938-8253-5080b626e169 could not be found. Jun 16 23:07:54.244492 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-8342c0ad-a1c0-44dc-89c3-38a47859cd4c tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Request method failure captured: Jun 16 23:07:54.244492 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: request: GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169 HTTP/1.1 Jun 16 23:07:54.244492 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Accept: application/json Jun 16 23:07:54.244492 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Accept-Encoding: identity Jun 16 23:07:54.244492 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Connection: close Jun 16 23:07:54.244492 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Content-Length: 0 Jun 16 23:07:54.244492 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Content-Type: application/json Jun 16 23:07:54.244492 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Host: 10.222.0.17 Jun 16 23:07:54.244492 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Openstack-System-Scope: None Jun 16 23:07:54.244492 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: User-Agent: python-urllib3/1.26.9 Jun 16 23:07:54.244492 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Auth-Token: gAAAAABiq7YkgiffNcWtxIe1f-Ym0r_NFffERJq1DAa6U7CivInFe3qIgAFqxI9XpTHPB4nvxD_hmw4DL7Hkzl06iEFyRPrqAmh_eIIzJ0mr-rBV0EZooAA5T9EpRJ9h0qd9xe0xEBWxM8y8kHq-41mybPXG0kgmM3CmX8N5E-dMI_xz415q7Zg Jun 16 23:07:54.244492 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Domain-Id: None Jun 16 23:07:54.244492 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Domain-Name: None Jun 16 23:07:54.244492 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Identity-Status: Confirmed Jun 16 23:07:54.244492 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Is-Admin-Project: True Jun 16 23:07:54.244492 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Openstack-Nova-Api-Version: 2.20 Jun 16 23:07:54.244492 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Project-Domain-Id: default Jun 16 23:07:54.244492 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Project-Domain-Name: Default Jun 16 23:07:54.244492 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Project-Id: 6fc0acf708204e1f8f4510cdb1bbf442 Jun 16 23:07:54.244492 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2045494089 Jun 16 23:07:54.244492 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Role: member,reader Jun 16 23:07:54.244492 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Roles: member,reader Jun 16 23:07:54.246151 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6fc0acf708204e1f8f4510cdb1bbf442"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6fc0acf708204e1f8f4510cdb1bbf442"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6fc0acf708204e1f8f4510cdb1bbf442"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6fc0acf708204e1f8f4510cdb1bbf442"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Jun 16 23:07:54.246151 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2045494089 Jun 16 23:07:54.246151 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Tenant-Id: 6fc0acf708204e1f8f4510cdb1bbf442 Jun 16 23:07:54.246151 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2045494089 Jun 16 23:07:54.246151 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-User: tempest-AttachVolumeShelveTestJSON-2045494089-project Jun 16 23:07:54.246151 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-User-Domain-Id: default Jun 16 23:07:54.246151 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-User-Domain-Name: Default Jun 16 23:07:54.246151 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-User-Id: a1b1a557a3834b98a3397c41665b5dc6 Jun 16 23:07:54.246151 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2045494089-project Jun 16 23:07:54.246151 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: method: > Jun 16 23:07:54.246151 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: exception: Instance 46f43909-d681-4938-8253-5080b626e169 could not be found. Jun 16 23:07:54.246151 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: action_args: {'id': '46f43909-d681-4938-8253-5080b626e169'} Jun 16 23:07:54.247067 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 23:07:54.247067 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 23:07:54.247067 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 23:07:54.247067 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 23:07:54.247067 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 23:07:54.247067 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 23:07:54.247067 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 23:07:54.247067 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 23:07:54.247067 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 23:07:54.247067 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 23:07:54.247067 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46f43909-d681-4938-8253-5080b626e169 could not be found. Jun 16 23:07:54.247067 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Jun 16 23:07:54.247067 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 23:07:54.247067 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Jun 16 23:07:54.247067 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 23:07:54.247067 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 23:07:54.247067 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 23:07:54.247067 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 23:07:54.247067 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 23:07:54.247067 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 23:07:54.248482 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 23:07:54.248482 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 23:07:54.248482 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 23:07:54.248482 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 23:07:54.248482 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 23:07:54.248482 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 23:07:54.248482 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 23:07:54.248482 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46f43909-d681-4938-8253-5080b626e169 could not be found. Jun 16 23:07:54.248482 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Jun 16 23:07:54.248482 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 23:07:54.248482 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Jun 16 23:07:54.248482 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 23:07:54.248482 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 23:07:54.248482 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 23:07:54.248482 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 23:07:54.248482 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 23:07:54.248482 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46f43909-d681-4938-8253-5080b626e169 could not be found. Jun 16 23:07:54.248482 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Jun 16 23:07:54.252086 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-8342c0ad-a1c0-44dc-89c3-38a47859cd4c tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] Returning 404 to user: Instance 46f43909-d681-4938-8253-5080b626e169 could not be found. {{(pid=117562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 23:07:54.252086 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-8342c0ad-a1c0-44dc-89c3-38a47859cd4c tempest-AttachVolumeShelveTestJSON-2045494089 tempest-AttachVolumeShelveTestJSON-2045494089-project] 10.222.0.17 "GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169" status: 404 len: 111 microversion: 2.20 time: 0.045727 Jun 16 23:07:54.252086 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 505/996] 10.222.0.17 () {60 vars in 1276 bytes} [Thu Jun 16 23:07:54 2022] GET /compute/v2.1/servers/46f43909-d681-4938-8253-5080b626e169 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 16 23:07:55.341942 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-f10c0282-2e5b-4619-bf11-1470ad0de5bd tempest-VolumesNegativeTest-2054282940 tempest-VolumesNegativeTest-2054282940-project] Action: 'create', calling method: .version_select at 0x7f5320132160>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1303602689", "metadata": {"Type": "work"}}} {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 23:07:55.356004 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-f10c0282-2e5b-4619-bf11-1470ad0de5bd tempest-VolumesNegativeTest-2054282940 tempest-VolumesNegativeTest-2054282940-project] Request method failure captured: Jun 16 23:07:55.356004 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 16 23:07:55.356004 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Accept: application/json Jun 16 23:07:55.356004 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Accept-Encoding: identity Jun 16 23:07:55.356004 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Connection: close Jun 16 23:07:55.356004 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Content-Length: 122 Jun 16 23:07:55.356004 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Content-Type: application/json Jun 16 23:07:55.356004 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Host: 10.222.0.17 Jun 16 23:07:55.356004 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Openstack-System-Scope: None Jun 16 23:07:55.356004 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: User-Agent: python-urllib3/1.26.9 Jun 16 23:07:55.356004 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Auth-Token: gAAAAABiq7fKJ2VOcpnMuUzHgxXwCOm-0dByy-POKUjQ0pHBz0JNA1hpC8iO4eCC5oVk4o0MMGzNjpmjq1ZFlQkhdD6dDQnH5-Erkzn-CQEDIeiXexIB1MCW_-_LNF4LJgzXXTzxudsKlYy4IzaEOiIpno809iLLjmuT9ncn-2K-gTKiiSq8p9Q Jun 16 23:07:55.356004 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Domain-Id: None Jun 16 23:07:55.356004 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Domain-Name: None Jun 16 23:07:55.356004 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Identity-Status: Confirmed Jun 16 23:07:55.356004 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Is-Admin-Project: True Jun 16 23:07:55.356004 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Project-Domain-Id: default Jun 16 23:07:55.356004 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Project-Domain-Name: Default Jun 16 23:07:55.356004 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Project-Id: f84064db84a441a1a146641cf69efda1 Jun 16 23:07:55.356004 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Project-Name: tempest-VolumesNegativeTest-2054282940 Jun 16 23:07:55.356004 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Role: member,reader Jun 16 23:07:55.356004 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Roles: member,reader Jun 16 23:07:55.357445 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/f84064db84a441a1a146641cf69efda1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_f84064db84a441a1a146641cf69efda1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f84064db84a441a1a146641cf69efda1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f84064db84a441a1a146641cf69efda1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Jun 16 23:07:55.357445 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Tenant: tempest-VolumesNegativeTest-2054282940 Jun 16 23:07:55.357445 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Tenant-Id: f84064db84a441a1a146641cf69efda1 Jun 16 23:07:55.357445 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Tenant-Name: tempest-VolumesNegativeTest-2054282940 Jun 16 23:07:55.357445 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-User: tempest-VolumesNegativeTest-2054282940-project Jun 16 23:07:55.357445 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-User-Domain-Id: default Jun 16 23:07:55.357445 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-User-Domain-Name: Default Jun 16 23:07:55.357445 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-User-Id: 230d5619188b4d27980be714b901c831 Jun 16 23:07:55.357445 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-User-Name: tempest-VolumesNegativeTest-2054282940-project Jun 16 23:07:55.357445 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Jun 16 23:07:55.357445 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1303602689", "metadata": {"Type": "work"}}} Jun 16 23:07:55.357445 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: method: Jun 16 23:07:55.357445 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 16 23:07:55.358286 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1303602689', 'metadata': {'Type': 'work'}}}} Jun 16 23:07:55.358286 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 23:07:55.358286 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 23:07:55.358286 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 16 23:07:55.358286 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 16 23:07:55.358286 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 16 23:07:55.358286 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi raise error Jun 16 23:07:55.358286 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jun 16 23:07:55.358286 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 16 23:07:55.358286 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 16 23:07:55.358286 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 16 23:07:55.358286 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 16 23:07:55.358286 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 16 23:07:55.358286 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi '#$%' Jun 16 23:07:55.358286 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 16 23:07:55.358286 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 23:07:55.358286 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 16 23:07:55.358286 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 23:07:55.358286 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 23:07:55.358286 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 23:07:55.358286 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 23:07:55.358286 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 23:07:55.359665 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 23:07:55.359665 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 23:07:55.359665 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 23:07:55.359665 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 23:07:55.359665 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 16 23:07:55.359665 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 16 23:07:55.359665 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 16 23:07:55.359665 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 16 23:07:55.359665 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 16 23:07:55.359665 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 16 23:07:55.359665 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 16 23:07:55.359665 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 16 23:07:55.359665 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 23:07:55.359665 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 16 23:07:55.359665 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 23:07:55.359665 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 23:07:55.359665 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 23:07:55.359665 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 16 23:07:55.359665 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 16 23:07:55.360812 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 16 23:07:55.360812 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 16 23:07:55.360812 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-f10c0282-2e5b-4619-bf11-1470ad0de5bd tempest-VolumesNegativeTest-2054282940 tempest-VolumesNegativeTest-2054282940-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 23:07:55.360812 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-f10c0282-2e5b-4619-bf11-1470ad0de5bd tempest-VolumesNegativeTest-2054282940 tempest-VolumesNegativeTest-2054282940-project] 10.222.0.17 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.282257 Jun 16 23:07:55.362967 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 492/997] 10.222.0.17 () {60 vars in 1155 bytes} [Thu Jun 16 23:07:55 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 288 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 16 23:07:55.367791 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-8e231166-2336-487a-ab19-25ea82242e47 tempest-VolumesNegativeTest-2054282940 tempest-VolumesNegativeTest-2054282940-project] Action: 'create', calling method: .version_select at 0x7f5313e71700>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1046506071", "metadata": {"Type": "work"}}} {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 23:07:55.371871 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-8e231166-2336-487a-ab19-25ea82242e47 tempest-VolumesNegativeTest-2054282940 tempest-VolumesNegativeTest-2054282940-project] Request method failure captured: Jun 16 23:07:55.371871 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 16 23:07:55.371871 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Accept: application/json Jun 16 23:07:55.371871 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Accept-Encoding: identity Jun 16 23:07:55.371871 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Connection: close Jun 16 23:07:55.371871 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Content-Length: 120 Jun 16 23:07:55.371871 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Content-Type: application/json Jun 16 23:07:55.371871 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Host: 10.222.0.17 Jun 16 23:07:55.371871 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Openstack-System-Scope: None Jun 16 23:07:55.371871 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: User-Agent: python-urllib3/1.26.9 Jun 16 23:07:55.371871 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Auth-Token: gAAAAABiq7fKJ2VOcpnMuUzHgxXwCOm-0dByy-POKUjQ0pHBz0JNA1hpC8iO4eCC5oVk4o0MMGzNjpmjq1ZFlQkhdD6dDQnH5-Erkzn-CQEDIeiXexIB1MCW_-_LNF4LJgzXXTzxudsKlYy4IzaEOiIpno809iLLjmuT9ncn-2K-gTKiiSq8p9Q Jun 16 23:07:55.371871 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Domain-Id: None Jun 16 23:07:55.371871 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Domain-Name: None Jun 16 23:07:55.371871 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Identity-Status: Confirmed Jun 16 23:07:55.371871 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Is-Admin-Project: True Jun 16 23:07:55.371871 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Project-Domain-Id: default Jun 16 23:07:55.371871 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Project-Domain-Name: Default Jun 16 23:07:55.371871 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Project-Id: f84064db84a441a1a146641cf69efda1 Jun 16 23:07:55.371871 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Project-Name: tempest-VolumesNegativeTest-2054282940 Jun 16 23:07:55.371871 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Role: member,reader Jun 16 23:07:55.371871 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Roles: member,reader Jun 16 23:07:55.373424 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/f84064db84a441a1a146641cf69efda1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_f84064db84a441a1a146641cf69efda1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f84064db84a441a1a146641cf69efda1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f84064db84a441a1a146641cf69efda1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Jun 16 23:07:55.373424 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Tenant: tempest-VolumesNegativeTest-2054282940 Jun 16 23:07:55.373424 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Tenant-Id: f84064db84a441a1a146641cf69efda1 Jun 16 23:07:55.373424 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Tenant-Name: tempest-VolumesNegativeTest-2054282940 Jun 16 23:07:55.373424 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-User: tempest-VolumesNegativeTest-2054282940-project Jun 16 23:07:55.373424 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-User-Domain-Id: default Jun 16 23:07:55.373424 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-User-Domain-Name: Default Jun 16 23:07:55.373424 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-User-Id: 230d5619188b4d27980be714b901c831 Jun 16 23:07:55.373424 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-User-Name: tempest-VolumesNegativeTest-2054282940-project Jun 16 23:07:55.373424 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Jun 16 23:07:55.373424 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1046506071", "metadata": {"Type": "work"}}} Jun 16 23:07:55.373424 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: method: Jun 16 23:07:55.373424 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 16 23:07:55.374830 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1046506071', 'metadata': {'Type': 'work'}}}} Jun 16 23:07:55.374830 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 23:07:55.374830 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 23:07:55.374830 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 16 23:07:55.374830 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 16 23:07:55.374830 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 16 23:07:55.374830 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi raise error Jun 16 23:07:55.374830 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jun 16 23:07:55.374830 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Jun 16 23:07:55.374830 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jun 16 23:07:55.374830 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 16 23:07:55.374830 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Jun 16 23:07:55.374830 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 16 23:07:55.374830 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi '0' Jun 16 23:07:55.374830 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Jun 16 23:07:55.374830 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 23:07:55.374830 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Jun 16 23:07:55.374830 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 23:07:55.374830 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 23:07:55.374830 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 23:07:55.374830 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 23:07:55.374830 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 23:07:55.376290 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 23:07:55.376290 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 23:07:55.376290 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 23:07:55.376290 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 23:07:55.376290 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 16 23:07:55.376290 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 16 23:07:55.376290 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 16 23:07:55.376290 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 16 23:07:55.376290 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 16 23:07:55.376290 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 16 23:07:55.376290 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 16 23:07:55.376290 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Jun 16 23:07:55.376290 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 23:07:55.376290 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Jun 16 23:07:55.376290 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 23:07:55.376290 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 23:07:55.376290 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 23:07:55.376290 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 16 23:07:55.376290 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 16 23:07:55.377507 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 16 23:07:55.377507 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Jun 16 23:07:55.377507 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-8e231166-2336-487a-ab19-25ea82242e47 tempest-VolumesNegativeTest-2054282940 tempest-VolumesNegativeTest-2054282940-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 23:07:55.377507 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-8e231166-2336-487a-ab19-25ea82242e47 tempest-VolumesNegativeTest-2054282940 tempest-VolumesNegativeTest-2054282940-project] 10.222.0.17 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.009342 Jun 16 23:07:55.377507 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 506/998] 10.222.0.17 () {60 vars in 1155 bytes} [Thu Jun 16 23:07:55 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 16 23:07:55.383870 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-3ff25cd3-684d-4533-8770-efd53f4a133c tempest-VolumesNegativeTest-2054282940 tempest-VolumesNegativeTest-2054282940-project] Action: 'create', calling method: .version_select at 0x7f53200354c0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1007362927", "metadata": {"Type": "work"}}} {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 23:07:55.386805 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-3ff25cd3-684d-4533-8770-efd53f4a133c tempest-VolumesNegativeTest-2054282940 tempest-VolumesNegativeTest-2054282940-project] Request method failure captured: Jun 16 23:07:55.386805 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 16 23:07:55.386805 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Accept: application/json Jun 16 23:07:55.386805 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Accept-Encoding: identity Jun 16 23:07:55.386805 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Connection: close Jun 16 23:07:55.386805 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Content-Length: 119 Jun 16 23:07:55.386805 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Content-Type: application/json Jun 16 23:07:55.386805 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Host: 10.222.0.17 Jun 16 23:07:55.386805 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Openstack-System-Scope: None Jun 16 23:07:55.386805 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: User-Agent: python-urllib3/1.26.9 Jun 16 23:07:55.386805 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Auth-Token: gAAAAABiq7fKJ2VOcpnMuUzHgxXwCOm-0dByy-POKUjQ0pHBz0JNA1hpC8iO4eCC5oVk4o0MMGzNjpmjq1ZFlQkhdD6dDQnH5-Erkzn-CQEDIeiXexIB1MCW_-_LNF4LJgzXXTzxudsKlYy4IzaEOiIpno809iLLjmuT9ncn-2K-gTKiiSq8p9Q Jun 16 23:07:55.386805 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Domain-Id: None Jun 16 23:07:55.386805 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Domain-Name: None Jun 16 23:07:55.386805 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Identity-Status: Confirmed Jun 16 23:07:55.386805 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Is-Admin-Project: True Jun 16 23:07:55.386805 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Project-Domain-Id: default Jun 16 23:07:55.386805 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Project-Domain-Name: Default Jun 16 23:07:55.386805 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Project-Id: f84064db84a441a1a146641cf69efda1 Jun 16 23:07:55.386805 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Project-Name: tempest-VolumesNegativeTest-2054282940 Jun 16 23:07:55.386805 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Role: member,reader Jun 16 23:07:55.386805 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Roles: member,reader Jun 16 23:07:55.388165 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/f84064db84a441a1a146641cf69efda1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_f84064db84a441a1a146641cf69efda1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f84064db84a441a1a146641cf69efda1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f84064db84a441a1a146641cf69efda1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Jun 16 23:07:55.388165 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Tenant: tempest-VolumesNegativeTest-2054282940 Jun 16 23:07:55.388165 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Tenant-Id: f84064db84a441a1a146641cf69efda1 Jun 16 23:07:55.388165 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Tenant-Name: tempest-VolumesNegativeTest-2054282940 Jun 16 23:07:55.388165 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-User: tempest-VolumesNegativeTest-2054282940-project Jun 16 23:07:55.388165 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-User-Domain-Id: default Jun 16 23:07:55.388165 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-User-Domain-Name: Default Jun 16 23:07:55.388165 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-User-Id: 230d5619188b4d27980be714b901c831 Jun 16 23:07:55.388165 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-User-Name: tempest-VolumesNegativeTest-2054282940-project Jun 16 23:07:55.388165 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Jun 16 23:07:55.388165 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1007362927", "metadata": {"Type": "work"}}} Jun 16 23:07:55.388165 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: method: Jun 16 23:07:55.388165 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 16 23:07:55.388980 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1007362927', 'metadata': {'Type': 'work'}}}} Jun 16 23:07:55.388980 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 23:07:55.388980 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 23:07:55.388980 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 16 23:07:55.388980 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 16 23:07:55.388980 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 16 23:07:55.388980 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi raise error Jun 16 23:07:55.388980 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jun 16 23:07:55.388980 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 16 23:07:55.388980 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 16 23:07:55.388980 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 16 23:07:55.388980 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 16 23:07:55.388980 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 16 23:07:55.388980 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi '' Jun 16 23:07:55.388980 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 16 23:07:55.388980 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 23:07:55.388980 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 16 23:07:55.388980 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 23:07:55.388980 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 23:07:55.388980 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 23:07:55.388980 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 23:07:55.388980 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 23:07:55.390323 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 23:07:55.390323 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 23:07:55.390323 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 23:07:55.390323 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 23:07:55.390323 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 16 23:07:55.390323 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 16 23:07:55.390323 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 16 23:07:55.390323 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 16 23:07:55.390323 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 16 23:07:55.390323 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 16 23:07:55.390323 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 16 23:07:55.390323 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 16 23:07:55.390323 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 23:07:55.390323 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 16 23:07:55.390323 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 23:07:55.390323 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 23:07:55.390323 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 23:07:55.390323 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 16 23:07:55.390323 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 16 23:07:55.395497 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 16 23:07:55.395497 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 16 23:07:55.395497 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-3ff25cd3-684d-4533-8770-efd53f4a133c tempest-VolumesNegativeTest-2054282940 tempest-VolumesNegativeTest-2054282940-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 23:07:55.395497 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-3ff25cd3-684d-4533-8770-efd53f4a133c tempest-VolumesNegativeTest-2054282940 tempest-VolumesNegativeTest-2054282940-project] 10.222.0.17 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.008614 Jun 16 23:07:55.395497 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 493/999] 10.222.0.17 () {60 vars in 1155 bytes} [Thu Jun 16 23:07:55 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 16 23:07:55.400737 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-c765cd4d-ed4c-46f8-9549-521fde8276b4 tempest-VolumesNegativeTest-2054282940 tempest-VolumesNegativeTest-2054282940-project] Calling method '.version_select at 0x7f5313dd6940>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:07:55.432003 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.wsgi [None req-c765cd4d-ed4c-46f8-9549-521fde8276b4 tempest-VolumesNegativeTest-2054282940 tempest-VolumesNegativeTest-2054282940-project] HTTP exception thrown: Volume tempest-invalid-1376801616 could not be found. Jun 16 23:07:55.434686 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-c765cd4d-ed4c-46f8-9549-521fde8276b4 tempest-VolumesNegativeTest-2054282940 tempest-VolumesNegativeTest-2054282940-project] Request method failure captured: Jun 16 23:07:55.434686 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1376801616 HTTP/1.1 Jun 16 23:07:55.434686 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Accept: application/json Jun 16 23:07:55.434686 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Accept-Encoding: identity Jun 16 23:07:55.434686 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Connection: close Jun 16 23:07:55.434686 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Content-Length: 0 Jun 16 23:07:55.434686 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Content-Type: application/json Jun 16 23:07:55.434686 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Host: 10.222.0.17 Jun 16 23:07:55.434686 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Openstack-System-Scope: None Jun 16 23:07:55.434686 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: User-Agent: python-urllib3/1.26.9 Jun 16 23:07:55.434686 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Auth-Token: gAAAAABiq7fKJ2VOcpnMuUzHgxXwCOm-0dByy-POKUjQ0pHBz0JNA1hpC8iO4eCC5oVk4o0MMGzNjpmjq1ZFlQkhdD6dDQnH5-Erkzn-CQEDIeiXexIB1MCW_-_LNF4LJgzXXTzxudsKlYy4IzaEOiIpno809iLLjmuT9ncn-2K-gTKiiSq8p9Q Jun 16 23:07:55.434686 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Domain-Id: None Jun 16 23:07:55.434686 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Domain-Name: None Jun 16 23:07:55.434686 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Identity-Status: Confirmed Jun 16 23:07:55.434686 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Is-Admin-Project: True Jun 16 23:07:55.434686 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Project-Domain-Id: default Jun 16 23:07:55.434686 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Project-Domain-Name: Default Jun 16 23:07:55.434686 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Project-Id: f84064db84a441a1a146641cf69efda1 Jun 16 23:07:55.434686 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Project-Name: tempest-VolumesNegativeTest-2054282940 Jun 16 23:07:55.434686 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Role: member,reader Jun 16 23:07:55.434686 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Roles: member,reader Jun 16 23:07:55.436351 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/f84064db84a441a1a146641cf69efda1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_f84064db84a441a1a146641cf69efda1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f84064db84a441a1a146641cf69efda1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f84064db84a441a1a146641cf69efda1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Jun 16 23:07:55.436351 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Tenant: tempest-VolumesNegativeTest-2054282940 Jun 16 23:07:55.436351 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Tenant-Id: f84064db84a441a1a146641cf69efda1 Jun 16 23:07:55.436351 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Tenant-Name: tempest-VolumesNegativeTest-2054282940 Jun 16 23:07:55.436351 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-User: tempest-VolumesNegativeTest-2054282940-project Jun 16 23:07:55.436351 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-User-Domain-Id: default Jun 16 23:07:55.436351 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-User-Domain-Name: Default Jun 16 23:07:55.436351 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-User-Id: 230d5619188b4d27980be714b901c831 Jun 16 23:07:55.436351 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-User-Name: tempest-VolumesNegativeTest-2054282940-project Jun 16 23:07:55.436351 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: method: Jun 16 23:07:55.436351 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: exception: Volume tempest-invalid-1376801616 could not be found. Jun 16 23:07:55.436351 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: action_args: {'id': 'tempest-invalid-1376801616'} Jun 16 23:07:55.436351 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 23:07:55.437238 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 23:07:55.437238 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 23:07:55.437238 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 23:07:55.437238 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 16 23:07:55.437238 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 16 23:07:55.437238 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 16 23:07:55.437238 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 16 23:07:55.437238 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 16 23:07:55.437238 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 16 23:07:55.437238 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 16 23:07:55.437238 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 16 23:07:55.437238 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 23:07:55.437238 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 23:07:55.437238 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 23:07:55.437238 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 23:07:55.437238 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1376801616 could not be found. (HTTP 404) (Request-ID: req-37301113-747b-4d14-85c1-33ad91b5aef3) Jun 16 23:07:55.437238 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Jun 16 23:07:55.437238 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 23:07:55.437238 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Jun 16 23:07:55.439387 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 23:07:55.439387 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 16 23:07:55.439387 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 16 23:07:55.439387 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 16 23:07:55.439387 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 16 23:07:55.439387 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 16 23:07:55.439387 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 16 23:07:55.439387 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 16 23:07:55.439387 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 16 23:07:55.439387 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 23:07:55.439387 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 23:07:55.439387 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 16 23:07:55.439387 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 16 23:07:55.439387 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 16 23:07:55.439387 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 16 23:07:55.439387 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 16 23:07:55.439387 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 16 23:07:55.439387 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 16 23:07:55.439387 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 16 23:07:55.441759 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 23:07:55.441759 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 23:07:55.441759 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 23:07:55.441759 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 23:07:55.441759 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1376801616 could not be found. Jun 16 23:07:55.441759 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Jun 16 23:07:55.441759 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 23:07:55.441759 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Jun 16 23:07:55.441759 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 23:07:55.441759 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 23:07:55.441759 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 23:07:55.441759 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 23:07:55.441759 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 23:07:55.441759 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 23:07:55.441759 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 23:07:55.441759 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 23:07:55.441759 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 23:07:55.441759 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 16 23:07:55.441759 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 23:07:55.441759 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1376801616 could not be found. Jun 16 23:07:55.444599 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Jun 16 23:07:55.444599 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 23:07:55.444599 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Jun 16 23:07:55.444599 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 23:07:55.444599 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 23:07:55.444599 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 23:07:55.444599 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 23:07:55.444599 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 23:07:55.444599 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1376801616 could not be found. Jun 16 23:07:55.444599 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Jun 16 23:07:55.444599 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-c765cd4d-ed4c-46f8-9549-521fde8276b4 tempest-VolumesNegativeTest-2054282940 tempest-VolumesNegativeTest-2054282940-project] Returning 404 to user: Volume tempest-invalid-1376801616 could not be found. {{(pid=117562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 23:07:55.444599 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-c765cd4d-ed4c-46f8-9549-521fde8276b4 tempest-VolumesNegativeTest-2054282940 tempest-VolumesNegativeTest-2054282940-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1376801616" status: 404 len: 99 microversion: 2.1 time: 0.040508 Jun 16 23:07:55.446208 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-cba86611-94f8-4dd5-9e1b-252dd1e559e9 tempest-VolumesNegativeTest-2054282940 tempest-VolumesNegativeTest-2054282940-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004088 Jun 16 23:07:55.447133 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 507/1000] 10.222.0.17 () {58 vars in 1217 bytes} [Thu Jun 16 23:07:55 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1376801616 => generated 99 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 16 23:07:55.447784 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 494/1001] 10.222.0.17 () {58 vars in 1139 bytes} [Thu Jun 16 23:07:55 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 16 23:07:55.457088 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-cb88d1b9-6940-461b-aea4-beda4cd810ab tempest-VolumesNegativeTest-2054282940 tempest-VolumesNegativeTest-2054282940-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004195 Jun 16 23:07:55.457868 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 508/1002] 10.222.0.17 () {58 vars in 1136 bytes} [Thu Jun 16 23:07:55 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Jun 16 23:07:55.467380 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-6ef1352f-8152-4172-9533-e9abf37ce410 tempest-VolumesNegativeTest-2054282940 tempest-VolumesNegativeTest-2054282940-project] Calling method '.version_select at 0x7f5320132160>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:07:55.499460 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.wsgi [None req-6ef1352f-8152-4172-9533-e9abf37ce410 tempest-VolumesNegativeTest-2054282940 tempest-VolumesNegativeTest-2054282940-project] HTTP exception thrown: Volume c002e4d8-bd37-407c-a591-a74a65c66c18 could not be found. Jun 16 23:07:55.501947 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-6ef1352f-8152-4172-9533-e9abf37ce410 tempest-VolumesNegativeTest-2054282940 tempest-VolumesNegativeTest-2054282940-project] Request method failure captured: Jun 16 23:07:55.501947 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: request: DELETE /compute/v2.1/os-volumes/c002e4d8-bd37-407c-a591-a74a65c66c18 HTTP/1.1 Jun 16 23:07:55.501947 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Accept: application/json Jun 16 23:07:55.501947 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Accept-Encoding: identity Jun 16 23:07:55.501947 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Connection: close Jun 16 23:07:55.501947 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Content-Length: 0 Jun 16 23:07:55.501947 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Content-Type: application/json Jun 16 23:07:55.501947 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Host: 10.222.0.17 Jun 16 23:07:55.501947 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Openstack-System-Scope: None Jun 16 23:07:55.501947 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: User-Agent: python-urllib3/1.26.9 Jun 16 23:07:55.501947 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Auth-Token: gAAAAABiq7fKJ2VOcpnMuUzHgxXwCOm-0dByy-POKUjQ0pHBz0JNA1hpC8iO4eCC5oVk4o0MMGzNjpmjq1ZFlQkhdD6dDQnH5-Erkzn-CQEDIeiXexIB1MCW_-_LNF4LJgzXXTzxudsKlYy4IzaEOiIpno809iLLjmuT9ncn-2K-gTKiiSq8p9Q Jun 16 23:07:55.501947 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Domain-Id: None Jun 16 23:07:55.501947 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Domain-Name: None Jun 16 23:07:55.501947 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Identity-Status: Confirmed Jun 16 23:07:55.501947 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Is-Admin-Project: True Jun 16 23:07:55.501947 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Project-Domain-Id: default Jun 16 23:07:55.501947 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Project-Domain-Name: Default Jun 16 23:07:55.501947 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Project-Id: f84064db84a441a1a146641cf69efda1 Jun 16 23:07:55.501947 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Project-Name: tempest-VolumesNegativeTest-2054282940 Jun 16 23:07:55.501947 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Role: member,reader Jun 16 23:07:55.501947 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Roles: member,reader Jun 16 23:07:55.503374 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/f84064db84a441a1a146641cf69efda1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_f84064db84a441a1a146641cf69efda1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f84064db84a441a1a146641cf69efda1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f84064db84a441a1a146641cf69efda1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Jun 16 23:07:55.503374 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Tenant: tempest-VolumesNegativeTest-2054282940 Jun 16 23:07:55.503374 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Tenant-Id: f84064db84a441a1a146641cf69efda1 Jun 16 23:07:55.503374 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Tenant-Name: tempest-VolumesNegativeTest-2054282940 Jun 16 23:07:55.503374 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-User: tempest-VolumesNegativeTest-2054282940-project Jun 16 23:07:55.503374 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-User-Domain-Id: default Jun 16 23:07:55.503374 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-User-Domain-Name: Default Jun 16 23:07:55.503374 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-User-Id: 230d5619188b4d27980be714b901c831 Jun 16 23:07:55.503374 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-User-Name: tempest-VolumesNegativeTest-2054282940-project Jun 16 23:07:55.503374 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: method: Jun 16 23:07:55.503374 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: exception: Volume c002e4d8-bd37-407c-a591-a74a65c66c18 could not be found. Jun 16 23:07:55.503374 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: action_args: {'id': 'c002e4d8-bd37-407c-a591-a74a65c66c18'} Jun 16 23:07:55.503374 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 23:07:55.504170 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 23:07:55.504170 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 23:07:55.504170 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 23:07:55.504170 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 16 23:07:55.504170 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 16 23:07:55.504170 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 16 23:07:55.504170 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 16 23:07:55.504170 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 16 23:07:55.504170 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 16 23:07:55.504170 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 16 23:07:55.504170 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 16 23:07:55.504170 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 23:07:55.504170 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 23:07:55.504170 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 23:07:55.504170 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 23:07:55.504170 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c002e4d8-bd37-407c-a591-a74a65c66c18 could not be found. (HTTP 404) (Request-ID: req-fa6e8216-16a1-42f6-b490-2527ef18fd9f) Jun 16 23:07:55.504170 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 16 23:07:55.504170 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 23:07:55.504170 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 16 23:07:55.505323 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 23:07:55.505323 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 16 23:07:55.505323 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 16 23:07:55.505323 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 16 23:07:55.505323 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 16 23:07:55.505323 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 16 23:07:55.505323 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 16 23:07:55.505323 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 16 23:07:55.505323 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 16 23:07:55.505323 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 23:07:55.505323 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 23:07:55.505323 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 16 23:07:55.505323 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 16 23:07:55.505323 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 16 23:07:55.505323 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 16 23:07:55.505323 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 16 23:07:55.505323 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 16 23:07:55.505323 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 16 23:07:55.505323 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 16 23:07:55.507393 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 23:07:55.507393 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 23:07:55.507393 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 23:07:55.507393 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 23:07:55.507393 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c002e4d8-bd37-407c-a591-a74a65c66c18 could not be found. Jun 16 23:07:55.507393 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 16 23:07:55.507393 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 23:07:55.507393 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 16 23:07:55.507393 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 23:07:55.507393 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 23:07:55.507393 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 23:07:55.507393 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 23:07:55.507393 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 23:07:55.507393 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 23:07:55.507393 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 23:07:55.507393 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 23:07:55.507393 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 23:07:55.507393 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 16 23:07:55.507393 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 23:07:55.508921 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c002e4d8-bd37-407c-a591-a74a65c66c18 could not be found. Jun 16 23:07:55.508921 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 16 23:07:55.508921 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 23:07:55.508921 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 16 23:07:55.508921 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 23:07:55.508921 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 23:07:55.508921 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 23:07:55.508921 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 23:07:55.508921 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 23:07:55.508921 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c002e4d8-bd37-407c-a591-a74a65c66c18 could not be found. Jun 16 23:07:55.508921 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 16 23:07:55.508921 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-6ef1352f-8152-4172-9533-e9abf37ce410 tempest-VolumesNegativeTest-2054282940 tempest-VolumesNegativeTest-2054282940-project] Returning 404 to user: Volume c002e4d8-bd37-407c-a591-a74a65c66c18 could not be found. {{(pid=117563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 23:07:55.508921 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-6ef1352f-8152-4172-9533-e9abf37ce410 tempest-VolumesNegativeTest-2054282940 tempest-VolumesNegativeTest-2054282940-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/c002e4d8-bd37-407c-a591-a74a65c66c18" status: 404 len: 109 microversion: 2.1 time: 0.041592 Jun 16 23:07:55.508921 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 495/1003] 10.222.0.17 () {58 vars in 1247 bytes} [Thu Jun 16 23:07:55 2022] DELETE /compute/v2.1/os-volumes/c002e4d8-bd37-407c-a591-a74a65c66c18 => generated 109 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 23:07:55.516910 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-af983792-d572-49ae-aab6-ad7c46d283e6 tempest-VolumesNegativeTest-2054282940 tempest-VolumesNegativeTest-2054282940-project] Calling method '.version_select at 0x7f5313e71b80>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:07:55.552275 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.wsgi [None req-af983792-d572-49ae-aab6-ad7c46d283e6 tempest-VolumesNegativeTest-2054282940 tempest-VolumesNegativeTest-2054282940-project] HTTP exception thrown: Volume 05b68b2a-87e3-46bf-b1b9-229c1fdaa771 could not be found. Jun 16 23:07:55.554365 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-af983792-d572-49ae-aab6-ad7c46d283e6 tempest-VolumesNegativeTest-2054282940 tempest-VolumesNegativeTest-2054282940-project] Request method failure captured: Jun 16 23:07:55.554365 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: request: GET /compute/v2.1/os-volumes/05b68b2a-87e3-46bf-b1b9-229c1fdaa771 HTTP/1.1 Jun 16 23:07:55.554365 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Accept: application/json Jun 16 23:07:55.554365 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Accept-Encoding: identity Jun 16 23:07:55.554365 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Connection: close Jun 16 23:07:55.554365 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Content-Length: 0 Jun 16 23:07:55.554365 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Content-Type: application/json Jun 16 23:07:55.554365 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Host: 10.222.0.17 Jun 16 23:07:55.554365 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Openstack-System-Scope: None Jun 16 23:07:55.554365 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: User-Agent: python-urllib3/1.26.9 Jun 16 23:07:55.554365 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Auth-Token: gAAAAABiq7fKJ2VOcpnMuUzHgxXwCOm-0dByy-POKUjQ0pHBz0JNA1hpC8iO4eCC5oVk4o0MMGzNjpmjq1ZFlQkhdD6dDQnH5-Erkzn-CQEDIeiXexIB1MCW_-_LNF4LJgzXXTzxudsKlYy4IzaEOiIpno809iLLjmuT9ncn-2K-gTKiiSq8p9Q Jun 16 23:07:55.554365 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Domain-Id: None Jun 16 23:07:55.554365 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Domain-Name: None Jun 16 23:07:55.554365 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Identity-Status: Confirmed Jun 16 23:07:55.554365 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Is-Admin-Project: True Jun 16 23:07:55.554365 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Project-Domain-Id: default Jun 16 23:07:55.554365 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Project-Domain-Name: Default Jun 16 23:07:55.554365 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Project-Id: f84064db84a441a1a146641cf69efda1 Jun 16 23:07:55.554365 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Project-Name: tempest-VolumesNegativeTest-2054282940 Jun 16 23:07:55.554365 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Role: member,reader Jun 16 23:07:55.554365 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Roles: member,reader Jun 16 23:07:55.555990 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/f84064db84a441a1a146641cf69efda1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_f84064db84a441a1a146641cf69efda1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f84064db84a441a1a146641cf69efda1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f84064db84a441a1a146641cf69efda1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Jun 16 23:07:55.555990 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Tenant: tempest-VolumesNegativeTest-2054282940 Jun 16 23:07:55.555990 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Tenant-Id: f84064db84a441a1a146641cf69efda1 Jun 16 23:07:55.555990 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Tenant-Name: tempest-VolumesNegativeTest-2054282940 Jun 16 23:07:55.555990 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-User: tempest-VolumesNegativeTest-2054282940-project Jun 16 23:07:55.555990 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-User-Domain-Id: default Jun 16 23:07:55.555990 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-User-Domain-Name: Default Jun 16 23:07:55.555990 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-User-Id: 230d5619188b4d27980be714b901c831 Jun 16 23:07:55.555990 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-User-Name: tempest-VolumesNegativeTest-2054282940-project Jun 16 23:07:55.555990 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: method: Jun 16 23:07:55.555990 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: exception: Volume 05b68b2a-87e3-46bf-b1b9-229c1fdaa771 could not be found. Jun 16 23:07:55.555990 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: action_args: {'id': '05b68b2a-87e3-46bf-b1b9-229c1fdaa771'} Jun 16 23:07:55.555990 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 23:07:55.556957 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 23:07:55.556957 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 23:07:55.556957 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 23:07:55.556957 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 16 23:07:55.556957 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 16 23:07:55.556957 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 16 23:07:55.556957 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 16 23:07:55.556957 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 23:07:55.556957 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 23:07:55.556957 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 23:07:55.556957 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 23:07:55.556957 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 23:07:55.556957 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 23:07:55.556957 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 23:07:55.556957 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 23:07:55.556957 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 05b68b2a-87e3-46bf-b1b9-229c1fdaa771 could not be found. (HTTP 404) (Request-ID: req-88d14154-cc8e-403e-9878-90ff9dc359fc) Jun 16 23:07:55.556957 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Jun 16 23:07:55.556957 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 23:07:55.556957 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Jun 16 23:07:55.558291 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 23:07:55.558291 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 16 23:07:55.558291 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 16 23:07:55.558291 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 16 23:07:55.558291 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 16 23:07:55.558291 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 16 23:07:55.558291 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 16 23:07:55.558291 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 16 23:07:55.558291 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 16 23:07:55.558291 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 23:07:55.558291 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 23:07:55.558291 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 16 23:07:55.558291 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 16 23:07:55.558291 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 16 23:07:55.558291 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 16 23:07:55.558291 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 23:07:55.558291 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 23:07:55.558291 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 23:07:55.558291 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 23:07:55.559655 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 23:07:55.559655 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 23:07:55.559655 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 23:07:55.559655 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 23:07:55.559655 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 05b68b2a-87e3-46bf-b1b9-229c1fdaa771 could not be found. Jun 16 23:07:55.559655 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Jun 16 23:07:55.559655 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 23:07:55.559655 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Jun 16 23:07:55.559655 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 23:07:55.559655 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 23:07:55.559655 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 23:07:55.559655 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 23:07:55.559655 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 23:07:55.559655 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 23:07:55.559655 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 23:07:55.559655 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 23:07:55.559655 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 23:07:55.559655 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 16 23:07:55.559655 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 23:07:55.562292 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 05b68b2a-87e3-46bf-b1b9-229c1fdaa771 could not be found. Jun 16 23:07:55.562292 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Jun 16 23:07:55.562292 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 23:07:55.562292 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Jun 16 23:07:55.562292 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 23:07:55.562292 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 23:07:55.562292 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 23:07:55.562292 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 23:07:55.562292 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 23:07:55.562292 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 05b68b2a-87e3-46bf-b1b9-229c1fdaa771 could not be found. Jun 16 23:07:55.562292 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Jun 16 23:07:55.562292 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-af983792-d572-49ae-aab6-ad7c46d283e6 tempest-VolumesNegativeTest-2054282940 tempest-VolumesNegativeTest-2054282940-project] Returning 404 to user: Volume 05b68b2a-87e3-46bf-b1b9-229c1fdaa771 could not be found. {{(pid=117562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 23:07:55.562292 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-af983792-d572-49ae-aab6-ad7c46d283e6 tempest-VolumesNegativeTest-2054282940 tempest-VolumesNegativeTest-2054282940-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/05b68b2a-87e3-46bf-b1b9-229c1fdaa771" status: 404 len: 109 microversion: 2.1 time: 0.044381 Jun 16 23:07:55.562292 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 509/1004] 10.222.0.17 () {58 vars in 1244 bytes} [Thu Jun 16 23:07:55 2022] GET /compute/v2.1/os-volumes/05b68b2a-87e3-46bf-b1b9-229c1fdaa771 => generated 109 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 23:08:44.902204 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG dbcounter [-] [117563] Writing DB stats nova_api:SELECT=32,nova_api:DELETE=1 {{(pid=117563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 23:08:44.906712 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-78b3d116-83a7-4d1f-a261-f46a5fa9105c tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:08:44.907205 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-78b3d116-83a7-4d1f-a261-f46a5fa9105c tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] [instance: bf5049e3-3446-468a-a334-d87825e50af4] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:08:44.915472 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-78b3d116-83a7-4d1f-a261-f46a5fa9105c tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:08:44.915920 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-78b3d116-83a7-4d1f-a261-f46a5fa9105c tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:08:44.916682 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-78b3d116-83a7-4d1f-a261-f46a5fa9105c tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:08:44.917119 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-78b3d116-83a7-4d1f-a261-f46a5fa9105c tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:08:44.941200 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-78b3d116-83a7-4d1f-a261-f46a5fa9105c tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] [instance: bf5049e3-3446-468a-a334-d87825e50af4] Going to try to terminate instance {{(pid=117563) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 23:08:45.012662 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-78b3d116-83a7-4d1f-a261-f46a5fa9105c tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] 10.222.0.17 "DELETE /compute/v2.1/servers/bf5049e3-3446-468a-a334-d87825e50af4" status: 204 len: 0 microversion: 2.1 time: 0.111654 Jun 16 23:08:45.013234 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 496/1005] 10.222.0.17 () {58 vars in 1238 bytes} [Thu Jun 16 23:08:44 2022] DELETE /compute/v2.1/servers/bf5049e3-3446-468a-a334-d87825e50af4 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 23:08:45.018767 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG dbcounter [-] [117562] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1 {{(pid=117562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 23:08:45.019626 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG dbcounter [-] [117562] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 23:08:45.023785 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-9921790a-3be7-4bbc-a68d-2c6733c38991 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:08:45.024585 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-9921790a-3be7-4bbc-a68d-2c6733c38991 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] [instance: bf5049e3-3446-468a-a334-d87825e50af4] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:08:45.033619 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-9921790a-3be7-4bbc-a68d-2c6733c38991 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:08:45.034046 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-9921790a-3be7-4bbc-a68d-2c6733c38991 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:08:45.035363 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-9921790a-3be7-4bbc-a68d-2c6733c38991 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:08:45.035795 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-9921790a-3be7-4bbc-a68d-2c6733c38991 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:08:45.177961 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-9921790a-3be7-4bbc-a68d-2c6733c38991 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2697aa77265e4f5783f87ffb3d4992b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1423c05c42b14519b401e22e16062781', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:08:45.185628 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-9921790a-3be7-4bbc-a68d-2c6733c38991 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] 10.222.0.17 "GET /compute/v2.1/servers/bf5049e3-3446-468a-a334-d87825e50af4" status: 200 len: 1578 microversion: 2.1 time: 0.168439 Jun 16 23:08:45.186271 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 510/1006] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:08:45 2022] GET /compute/v2.1/servers/bf5049e3-3446-468a-a334-d87825e50af4 => generated 1578 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:08:46.204910 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-3a0323aa-17e6-45cd-bbd2-39dbcc952a82 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:08:46.205614 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-3a0323aa-17e6-45cd-bbd2-39dbcc952a82 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] [instance: bf5049e3-3446-468a-a334-d87825e50af4] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:08:46.212557 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-3a0323aa-17e6-45cd-bbd2-39dbcc952a82 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:08:46.213008 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-3a0323aa-17e6-45cd-bbd2-39dbcc952a82 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:08:46.213780 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-3a0323aa-17e6-45cd-bbd2-39dbcc952a82 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:08:46.214248 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-3a0323aa-17e6-45cd-bbd2-39dbcc952a82 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:08:46.345791 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-3a0323aa-17e6-45cd-bbd2-39dbcc952a82 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2697aa77265e4f5783f87ffb3d4992b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1423c05c42b14519b401e22e16062781', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:08:46.353222 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-3a0323aa-17e6-45cd-bbd2-39dbcc952a82 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] 10.222.0.17 "GET /compute/v2.1/servers/bf5049e3-3446-468a-a334-d87825e50af4" status: 200 len: 1578 microversion: 2.1 time: 0.152649 Jun 16 23:08:46.353780 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 497/1007] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:08:46 2022] GET /compute/v2.1/servers/bf5049e3-3446-468a-a334-d87825e50af4 => generated 1578 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:08:47.369204 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-2fd9854f-f74c-4c5f-8630-b0d08024c4c5 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:08:47.369817 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-2fd9854f-f74c-4c5f-8630-b0d08024c4c5 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] [instance: bf5049e3-3446-468a-a334-d87825e50af4] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:08:47.376288 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-2fd9854f-f74c-4c5f-8630-b0d08024c4c5 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:08:47.376738 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-2fd9854f-f74c-4c5f-8630-b0d08024c4c5 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:08:47.377505 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-2fd9854f-f74c-4c5f-8630-b0d08024c4c5 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:08:47.377945 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-2fd9854f-f74c-4c5f-8630-b0d08024c4c5 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:08:47.511707 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-2fd9854f-f74c-4c5f-8630-b0d08024c4c5 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2697aa77265e4f5783f87ffb3d4992b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1423c05c42b14519b401e22e16062781', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:08:47.519385 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-2fd9854f-f74c-4c5f-8630-b0d08024c4c5 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] 10.222.0.17 "GET /compute/v2.1/servers/bf5049e3-3446-468a-a334-d87825e50af4" status: 200 len: 1578 microversion: 2.1 time: 0.153985 Jun 16 23:08:47.523841 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 511/1008] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:08:47 2022] GET /compute/v2.1/servers/bf5049e3-3446-468a-a334-d87825e50af4 => generated 1578 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:08:48.536484 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-80d7c388-90b3-484a-96fa-078fb195fdc5 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:08:48.537173 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-80d7c388-90b3-484a-96fa-078fb195fdc5 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] [instance: bf5049e3-3446-468a-a334-d87825e50af4] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:08:48.543867 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-80d7c388-90b3-484a-96fa-078fb195fdc5 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:08:48.544326 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-80d7c388-90b3-484a-96fa-078fb195fdc5 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:08:48.545098 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-80d7c388-90b3-484a-96fa-078fb195fdc5 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:08:48.545537 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-80d7c388-90b3-484a-96fa-078fb195fdc5 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:08:48.699040 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-80d7c388-90b3-484a-96fa-078fb195fdc5 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2697aa77265e4f5783f87ffb3d4992b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1423c05c42b14519b401e22e16062781', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:08:48.707416 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-80d7c388-90b3-484a-96fa-078fb195fdc5 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] 10.222.0.17 "GET /compute/v2.1/servers/bf5049e3-3446-468a-a334-d87825e50af4" status: 200 len: 1578 microversion: 2.1 time: 0.174893 Jun 16 23:08:48.710685 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 498/1009] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:08:48 2022] GET /compute/v2.1/servers/bf5049e3-3446-468a-a334-d87825e50af4 => generated 1578 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:08:49.569695 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [req-04f6a658-6b17-49fe-88fb-ef5117f5fde2 req-56763887-0596-49f0-bc02-626fc8e1e206 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf5049e3-3446-468a-a334-d87825e50af4", "name": "network-vif-deleted", "tag": "bee8d2e1-8544-499c-8311-99767df2181b"}]} {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 23:08:49.578732 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [req-04f6a658-6b17-49fe-88fb-ef5117f5fde2 req-56763887-0596-49f0-bc02-626fc8e1e206 service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:08:49.579313 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [req-04f6a658-6b17-49fe-88fb-ef5117f5fde2 req-56763887-0596-49f0-bc02-626fc8e1e206 service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:08:49.592555 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.compute.server_external_events [req-04f6a658-6b17-49fe-88fb-ef5117f5fde2 req-56763887-0596-49f0-bc02-626fc8e1e206 service nova] Creating event network-vif-deleted:bee8d2e1-8544-499c-8311-99767df2181b for instance bf5049e3-3446-468a-a334-d87825e50af4 on hv-cinder-84623 Jun 16 23:08:49.597451 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [req-04f6a658-6b17-49fe-88fb-ef5117f5fde2 req-56763887-0596-49f0-bc02-626fc8e1e206 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032394 Jun 16 23:08:49.599103 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 512/1010] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 23:08:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 23:08:49.725090 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-70997181-4c92-49be-9370-f65886d44d79 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:08:49.726483 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-70997181-4c92-49be-9370-f65886d44d79 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] [instance: bf5049e3-3446-468a-a334-d87825e50af4] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:08:49.733761 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-70997181-4c92-49be-9370-f65886d44d79 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:08:49.734282 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-70997181-4c92-49be-9370-f65886d44d79 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:08:49.735508 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-70997181-4c92-49be-9370-f65886d44d79 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:08:49.736148 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-70997181-4c92-49be-9370-f65886d44d79 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:08:49.811392 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-70997181-4c92-49be-9370-f65886d44d79 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2697aa77265e4f5783f87ffb3d4992b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1423c05c42b14519b401e22e16062781', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:08:49.827747 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-70997181-4c92-49be-9370-f65886d44d79 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] 10.222.0.17 "GET /compute/v2.1/servers/bf5049e3-3446-468a-a334-d87825e50af4" status: 200 len: 1225 microversion: 2.1 time: 0.107046 Jun 16 23:08:49.833877 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 499/1011] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:08:49 2022] GET /compute/v2.1/servers/bf5049e3-3446-468a-a334-d87825e50af4 => generated 1225 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:08:50.845457 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-44dd5c43-206f-4ab6-ad3f-d7d1934f4060 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:08:50.846175 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-44dd5c43-206f-4ab6-ad3f-d7d1934f4060 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] [instance: bf5049e3-3446-468a-a334-d87825e50af4] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:08:50.852461 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-44dd5c43-206f-4ab6-ad3f-d7d1934f4060 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:08:50.852905 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-44dd5c43-206f-4ab6-ad3f-d7d1934f4060 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:08:50.853747 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-44dd5c43-206f-4ab6-ad3f-d7d1934f4060 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:08:50.854179 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-44dd5c43-206f-4ab6-ad3f-d7d1934f4060 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:08:50.867967 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.wsgi [None req-44dd5c43-206f-4ab6-ad3f-d7d1934f4060 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] HTTP exception thrown: Instance bf5049e3-3446-468a-a334-d87825e50af4 could not be found. Jun 16 23:08:50.869710 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-44dd5c43-206f-4ab6-ad3f-d7d1934f4060 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Request method failure captured: Jun 16 23:08:50.869710 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: request: GET /compute/v2.1/servers/bf5049e3-3446-468a-a334-d87825e50af4 HTTP/1.1 Jun 16 23:08:50.869710 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Accept: application/json Jun 16 23:08:50.869710 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Accept-Encoding: identity Jun 16 23:08:50.869710 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Connection: close Jun 16 23:08:50.869710 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Content-Length: 0 Jun 16 23:08:50.869710 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Content-Type: application/json Jun 16 23:08:50.869710 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Host: 10.222.0.17 Jun 16 23:08:50.869710 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Openstack-System-Scope: None Jun 16 23:08:50.869710 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: User-Agent: python-urllib3/1.26.9 Jun 16 23:08:50.869710 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Auth-Token: gAAAAABiq7dOTghxs_tntnNw6zIutFbhuM_ZrhXS_oTJGir2L7J96wc3GKbm_J5OvoayLMAwFR1CjQYDc_2fXeoXZ4wNuz4d_4FTDnPB953kS8XJuq31Uqz3xWu_VRxj_3nnOvVSKaz5t6cgTkeIf1ytphRKjBn_xLSR7dMTyeUq9Y_QtMiIm9c Jun 16 23:08:50.869710 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Domain-Id: None Jun 16 23:08:50.869710 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Domain-Name: None Jun 16 23:08:50.869710 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Identity-Status: Confirmed Jun 16 23:08:50.869710 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Is-Admin-Project: True Jun 16 23:08:50.869710 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Project-Domain-Id: default Jun 16 23:08:50.869710 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Project-Domain-Name: Default Jun 16 23:08:50.869710 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Project-Id: 1423c05c42b14519b401e22e16062781 Jun 16 23:08:50.869710 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Project-Name: tempest-TestVolumeBootPattern-591009407 Jun 16 23:08:50.869710 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Role: member,reader Jun 16 23:08:50.869710 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Roles: member,reader Jun 16 23:08:50.871355 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/1423c05c42b14519b401e22e16062781"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_1423c05c42b14519b401e22e16062781"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1423c05c42b14519b401e22e16062781"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1423c05c42b14519b401e22e16062781"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Jun 16 23:08:50.871355 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Tenant: tempest-TestVolumeBootPattern-591009407 Jun 16 23:08:50.871355 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Tenant-Id: 1423c05c42b14519b401e22e16062781 Jun 16 23:08:50.871355 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Tenant-Name: tempest-TestVolumeBootPattern-591009407 Jun 16 23:08:50.871355 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-User: tempest-TestVolumeBootPattern-591009407-project Jun 16 23:08:50.871355 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-User-Domain-Id: default Jun 16 23:08:50.871355 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-User-Domain-Name: Default Jun 16 23:08:50.871355 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-User-Id: 2697aa77265e4f5783f87ffb3d4992b5 Jun 16 23:08:50.871355 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-User-Name: tempest-TestVolumeBootPattern-591009407-project Jun 16 23:08:50.871355 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: method: > Jun 16 23:08:50.871355 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: exception: Instance bf5049e3-3446-468a-a334-d87825e50af4 could not be found. Jun 16 23:08:50.871355 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: action_args: {'id': 'bf5049e3-3446-468a-a334-d87825e50af4'} Jun 16 23:08:50.872321 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 23:08:50.872321 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 23:08:50.872321 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 23:08:50.872321 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 23:08:50.872321 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 23:08:50.872321 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 23:08:50.872321 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 23:08:50.872321 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 23:08:50.872321 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 23:08:50.872321 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 23:08:50.872321 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf5049e3-3446-468a-a334-d87825e50af4 could not be found. Jun 16 23:08:50.872321 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Jun 16 23:08:50.872321 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 23:08:50.872321 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Jun 16 23:08:50.872321 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 23:08:50.872321 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 23:08:50.872321 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 23:08:50.872321 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 23:08:50.872321 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 23:08:50.872321 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 23:08:50.873814 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 23:08:50.873814 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 23:08:50.873814 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 23:08:50.873814 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 23:08:50.873814 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 23:08:50.873814 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 23:08:50.873814 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 23:08:50.873814 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf5049e3-3446-468a-a334-d87825e50af4 could not be found. Jun 16 23:08:50.873814 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Jun 16 23:08:50.873814 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 23:08:50.873814 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Jun 16 23:08:50.873814 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 23:08:50.873814 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 23:08:50.873814 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 23:08:50.873814 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 23:08:50.873814 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 23:08:50.873814 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf5049e3-3446-468a-a334-d87825e50af4 could not be found. Jun 16 23:08:50.873814 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Jun 16 23:08:50.875286 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-44dd5c43-206f-4ab6-ad3f-d7d1934f4060 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Returning 404 to user: Instance bf5049e3-3446-468a-a334-d87825e50af4 could not be found. {{(pid=117562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 23:08:50.875286 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-44dd5c43-206f-4ab6-ad3f-d7d1934f4060 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] 10.222.0.17 "GET /compute/v2.1/servers/bf5049e3-3446-468a-a334-d87825e50af4" status: 404 len: 111 microversion: 2.1 time: 0.030428 Jun 16 23:08:50.879709 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 513/1012] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:08:50 2022] GET /compute/v2.1/servers/bf5049e3-3446-468a-a334-d87825e50af4 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 23:08:50.987118 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-800fdcca-5d37-4155-a5c0-05b450419a9b tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-571682665", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1351668635", "security_groups": [{"name": "tempest-secgroup-smoke-307129787"}], "block_device_mapping_v2": [{"uuid": "805e4f35-50db-4b56-91e5-8b3bbbd395fe", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "b60aa0be-29dc-41f5-b1f9-8245b5200d1c"}]}} {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 23:08:51.111783 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.network.neutron [None req-800fdcca-5d37-4155-a5c0-05b450419a9b tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] validate_networks() for [('b60aa0be-29dc-41f5-b1f9-8245b5200d1c', None, None, None, None, None)] {{(pid=117563) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 23:08:51.515165 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.virt.hardware [None req-800fdcca-5d37-4155-a5c0-05b450419a9b tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Flavor limits 0:0:0 {{(pid=117563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 23:08:51.515587 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.virt.hardware [None req-800fdcca-5d37-4155-a5c0-05b450419a9b tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Image limits 0:0:0 {{(pid=117563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 23:08:51.516060 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.virt.hardware [None req-800fdcca-5d37-4155-a5c0-05b450419a9b tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Flavor pref 0:0:0 {{(pid=117563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 23:08:51.516481 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.virt.hardware [None req-800fdcca-5d37-4155-a5c0-05b450419a9b tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Image pref 0:0:0 {{(pid=117563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 23:08:51.516880 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.virt.hardware [None req-800fdcca-5d37-4155-a5c0-05b450419a9b tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 23:08:51.527369 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-800fdcca-5d37-4155-a5c0-05b450419a9b tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:08:51.527940 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-800fdcca-5d37-4155-a5c0-05b450419a9b tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:08:51.529301 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-800fdcca-5d37-4155-a5c0-05b450419a9b tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:08:51.530094 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-800fdcca-5d37-4155-a5c0-05b450419a9b tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:08:51.549238 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.quota [None req-800fdcca-5d37-4155-a5c0-05b450419a9b tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Getting quotas for project 1423c05c42b14519b401e22e16062781. Resources: {'instances', 'cores', 'ram'} {{(pid=117563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 23:08:51.553571 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.quota [None req-800fdcca-5d37-4155-a5c0-05b450419a9b tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Getting quotas for user 2697aa77265e4f5783f87ffb3d4992b5 and project 1423c05c42b14519b401e22e16062781. Resources: {'instances', 'cores', 'ram'} {{(pid=117563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 23:08:51.617995 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-800fdcca-5d37-4155-a5c0-05b450419a9b tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Going to run 1 instances... {{(pid=117563) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 23:08:51.621325 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-800fdcca-5d37-4155-a5c0-05b450419a9b tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] [instance: 6fe2cc96-6822-4aa3-9dbf-169d3a688f3a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='805e4f35-50db-4b56-91e5-8b3bbbd395fe',volume_size=None,volume_type=None)] {{(pid=117563) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 23:08:51.809642 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-800fdcca-5d37-4155-a5c0-05b450419a9b tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.832140 Jun 16 23:08:51.810474 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 500/1013] 10.222.0.17 () {60 vars in 1146 bytes} [Thu Jun 16 23:08:50 2022] POST /compute/v2.1/servers => generated 405 bytes in 835 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 16 23:08:51.821421 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-8b11214a-02f8-402e-a107-e86ad907b3b6 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:08:51.822135 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-8b11214a-02f8-402e-a107-e86ad907b3b6 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] [instance: 6fe2cc96-6822-4aa3-9dbf-169d3a688f3a] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:08:51.894160 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-8b11214a-02f8-402e-a107-e86ad907b3b6 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2697aa77265e4f5783f87ffb3d4992b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1423c05c42b14519b401e22e16062781', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:08:51.901437 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-8b11214a-02f8-402e-a107-e86ad907b3b6 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] 10.222.0.17 "GET /compute/v2.1/servers/6fe2cc96-6822-4aa3-9dbf-169d3a688f3a" status: 200 len: 1094 microversion: 2.1 time: 0.084417 Jun 16 23:08:51.902000 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 514/1014] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:08:51 2022] GET /compute/v2.1/servers/6fe2cc96-6822-4aa3-9dbf-169d3a688f3a => generated 1094 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:08:52.920875 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-c1a4cc02-85ee-4e13-9835-354bad3d1f34 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:08:52.925787 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-c1a4cc02-85ee-4e13-9835-354bad3d1f34 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] [instance: 6fe2cc96-6822-4aa3-9dbf-169d3a688f3a] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:08:52.955132 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-c1a4cc02-85ee-4e13-9835-354bad3d1f34 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:08:52.955795 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-c1a4cc02-85ee-4e13-9835-354bad3d1f34 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:08:52.956749 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-c1a4cc02-85ee-4e13-9835-354bad3d1f34 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:08:52.957706 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-c1a4cc02-85ee-4e13-9835-354bad3d1f34 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:08:53.156026 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-c1a4cc02-85ee-4e13-9835-354bad3d1f34 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2697aa77265e4f5783f87ffb3d4992b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1423c05c42b14519b401e22e16062781', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:08:53.167193 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-c1a4cc02-85ee-4e13-9835-354bad3d1f34 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] 10.222.0.17 "GET /compute/v2.1/servers/6fe2cc96-6822-4aa3-9dbf-169d3a688f3a" status: 200 len: 1210 microversion: 2.1 time: 0.248527 Jun 16 23:08:53.170013 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 501/1015] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:08:52 2022] GET /compute/v2.1/servers/6fe2cc96-6822-4aa3-9dbf-169d3a688f3a => generated 1210 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:08:54.206434 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-a8195f1a-c6fa-4a5f-97d5-ffb20581acd4 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:08:54.207225 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-a8195f1a-c6fa-4a5f-97d5-ffb20581acd4 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] [instance: 6fe2cc96-6822-4aa3-9dbf-169d3a688f3a] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:08:54.223380 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-a8195f1a-c6fa-4a5f-97d5-ffb20581acd4 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:08:54.223834 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-a8195f1a-c6fa-4a5f-97d5-ffb20581acd4 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:08:54.224622 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-a8195f1a-c6fa-4a5f-97d5-ffb20581acd4 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:08:54.225133 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-a8195f1a-c6fa-4a5f-97d5-ffb20581acd4 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:08:54.438826 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-a8195f1a-c6fa-4a5f-97d5-ffb20581acd4 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2697aa77265e4f5783f87ffb3d4992b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1423c05c42b14519b401e22e16062781', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:08:54.449935 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-a8195f1a-c6fa-4a5f-97d5-ffb20581acd4 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] 10.222.0.17 "GET /compute/v2.1/servers/6fe2cc96-6822-4aa3-9dbf-169d3a688f3a" status: 200 len: 1265 microversion: 2.1 time: 0.267796 Jun 16 23:08:54.451232 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 515/1016] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:08:54 2022] GET /compute/v2.1/servers/6fe2cc96-6822-4aa3-9dbf-169d3a688f3a => generated 1265 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:08:54.816951 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [req-efe1c42e-27d5-41e1-8804-fe1c16cb006b req-426b9ec3-937e-4136-91c3-9d82339af36e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6fe2cc96-6822-4aa3-9dbf-169d3a688f3a", "tag": "3d02cfeb-d784-4f09-9198-cae370fc9285"}]} {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 23:08:54.831181 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-efe1c42e-27d5-41e1-8804-fe1c16cb006b req-426b9ec3-937e-4136-91c3-9d82339af36e service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:08:54.844277 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-efe1c42e-27d5-41e1-8804-fe1c16cb006b req-426b9ec3-937e-4136-91c3-9d82339af36e service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:08:54.891175 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.compute.server_external_events [req-efe1c42e-27d5-41e1-8804-fe1c16cb006b req-426b9ec3-937e-4136-91c3-9d82339af36e service nova] Creating event network-changed:3d02cfeb-d784-4f09-9198-cae370fc9285 for instance 6fe2cc96-6822-4aa3-9dbf-169d3a688f3a on hv-cinder-84623 Jun 16 23:08:54.897171 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [req-efe1c42e-27d5-41e1-8804-fe1c16cb006b req-426b9ec3-937e-4136-91c3-9d82339af36e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087845 Jun 16 23:08:54.898299 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 502/1017] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 23:08:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 23:08:55.469260 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-60f4f13d-42e4-45bd-bbda-97ae0f018a91 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:08:55.469912 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-60f4f13d-42e4-45bd-bbda-97ae0f018a91 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] [instance: 6fe2cc96-6822-4aa3-9dbf-169d3a688f3a] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:08:55.478198 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-60f4f13d-42e4-45bd-bbda-97ae0f018a91 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:08:55.478666 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-60f4f13d-42e4-45bd-bbda-97ae0f018a91 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:08:55.479441 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-60f4f13d-42e4-45bd-bbda-97ae0f018a91 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:08:55.479874 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-60f4f13d-42e4-45bd-bbda-97ae0f018a91 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:08:55.709324 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-60f4f13d-42e4-45bd-bbda-97ae0f018a91 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2697aa77265e4f5783f87ffb3d4992b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1423c05c42b14519b401e22e16062781', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:08:55.722379 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-60f4f13d-42e4-45bd-bbda-97ae0f018a91 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] 10.222.0.17 "GET /compute/v2.1/servers/6fe2cc96-6822-4aa3-9dbf-169d3a688f3a" status: 200 len: 1265 microversion: 2.1 time: 0.256722 Jun 16 23:08:55.722379 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 516/1018] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:08:55 2022] GET /compute/v2.1/servers/6fe2cc96-6822-4aa3-9dbf-169d3a688f3a => generated 1265 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:08:56.737169 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-eae22254-9e7d-4cd3-81fe-cb788cb2a8ab tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:08:56.737862 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-eae22254-9e7d-4cd3-81fe-cb788cb2a8ab tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] [instance: 6fe2cc96-6822-4aa3-9dbf-169d3a688f3a] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:08:56.749141 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-eae22254-9e7d-4cd3-81fe-cb788cb2a8ab tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:08:56.753281 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-eae22254-9e7d-4cd3-81fe-cb788cb2a8ab tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:08:56.754861 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-eae22254-9e7d-4cd3-81fe-cb788cb2a8ab tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:08:56.757547 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-eae22254-9e7d-4cd3-81fe-cb788cb2a8ab tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:08:57.154349 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-eae22254-9e7d-4cd3-81fe-cb788cb2a8ab tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2697aa77265e4f5783f87ffb3d4992b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1423c05c42b14519b401e22e16062781', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:08:57.162796 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-eae22254-9e7d-4cd3-81fe-cb788cb2a8ab tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] 10.222.0.17 "GET /compute/v2.1/servers/6fe2cc96-6822-4aa3-9dbf-169d3a688f3a" status: 200 len: 1265 microversion: 2.1 time: 0.429865 Jun 16 23:08:57.163365 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 503/1019] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:08:56 2022] GET /compute/v2.1/servers/6fe2cc96-6822-4aa3-9dbf-169d3a688f3a => generated 1265 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:08:58.182616 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-f25535f2-f2bb-40cc-a6f5-041218d8b1c1 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:08:58.183244 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-f25535f2-f2bb-40cc-a6f5-041218d8b1c1 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] [instance: 6fe2cc96-6822-4aa3-9dbf-169d3a688f3a] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:08:58.197084 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-f25535f2-f2bb-40cc-a6f5-041218d8b1c1 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:08:58.200349 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-f25535f2-f2bb-40cc-a6f5-041218d8b1c1 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:08:58.201574 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-f25535f2-f2bb-40cc-a6f5-041218d8b1c1 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:08:58.203585 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-f25535f2-f2bb-40cc-a6f5-041218d8b1c1 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:08:58.446215 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-f25535f2-f2bb-40cc-a6f5-041218d8b1c1 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2697aa77265e4f5783f87ffb3d4992b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1423c05c42b14519b401e22e16062781', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:08:58.454330 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-f25535f2-f2bb-40cc-a6f5-041218d8b1c1 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] 10.222.0.17 "GET /compute/v2.1/servers/6fe2cc96-6822-4aa3-9dbf-169d3a688f3a" status: 200 len: 1265 microversion: 2.1 time: 0.277249 Jun 16 23:08:58.455898 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 517/1020] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:08:58 2022] GET /compute/v2.1/servers/6fe2cc96-6822-4aa3-9dbf-169d3a688f3a => generated 1265 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:08:59.479770 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-c008f09b-84ea-4e26-8506-130e9d780c56 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:08:59.480660 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-c008f09b-84ea-4e26-8506-130e9d780c56 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] [instance: 6fe2cc96-6822-4aa3-9dbf-169d3a688f3a] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:08:59.489078 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-c008f09b-84ea-4e26-8506-130e9d780c56 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:08:59.489935 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-c008f09b-84ea-4e26-8506-130e9d780c56 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:08:59.490894 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-c008f09b-84ea-4e26-8506-130e9d780c56 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:08:59.491605 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-c008f09b-84ea-4e26-8506-130e9d780c56 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:08:59.724069 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-c008f09b-84ea-4e26-8506-130e9d780c56 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2697aa77265e4f5783f87ffb3d4992b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1423c05c42b14519b401e22e16062781', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:08:59.732190 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-c008f09b-84ea-4e26-8506-130e9d780c56 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] 10.222.0.17 "GET /compute/v2.1/servers/6fe2cc96-6822-4aa3-9dbf-169d3a688f3a" status: 200 len: 1265 microversion: 2.1 time: 0.259218 Jun 16 23:08:59.741477 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 504/1021] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:08:59 2022] GET /compute/v2.1/servers/6fe2cc96-6822-4aa3-9dbf-169d3a688f3a => generated 1265 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:09:00.751089 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-a0c30e00-52a7-4f18-a86b-eb28fe2d43a6 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:09:00.752520 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-a0c30e00-52a7-4f18-a86b-eb28fe2d43a6 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] [instance: 6fe2cc96-6822-4aa3-9dbf-169d3a688f3a] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:09:00.760280 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-a0c30e00-52a7-4f18-a86b-eb28fe2d43a6 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:09:00.760729 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-a0c30e00-52a7-4f18-a86b-eb28fe2d43a6 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:09:00.761512 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-a0c30e00-52a7-4f18-a86b-eb28fe2d43a6 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:09:00.761945 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-a0c30e00-52a7-4f18-a86b-eb28fe2d43a6 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:09:01.037030 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-a0c30e00-52a7-4f18-a86b-eb28fe2d43a6 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2697aa77265e4f5783f87ffb3d4992b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1423c05c42b14519b401e22e16062781', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:09:01.048452 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-a0c30e00-52a7-4f18-a86b-eb28fe2d43a6 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] 10.222.0.17 "GET /compute/v2.1/servers/6fe2cc96-6822-4aa3-9dbf-169d3a688f3a" status: 200 len: 1265 microversion: 2.1 time: 0.301320 Jun 16 23:09:01.050179 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 518/1022] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:09:00 2022] GET /compute/v2.1/servers/6fe2cc96-6822-4aa3-9dbf-169d3a688f3a => generated 1265 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 23:09:02.067978 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-716b2ad2-0979-4ab1-8266-aa9460c72d70 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:09:02.069562 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-716b2ad2-0979-4ab1-8266-aa9460c72d70 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] [instance: 6fe2cc96-6822-4aa3-9dbf-169d3a688f3a] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:09:02.077831 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG dbcounter [-] [117563] Writing DB stats nova_cell0:SELECT=2 {{(pid=117563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 23:09:02.078850 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG dbcounter [-] [117563] Writing DB stats nova_cell0:SELECT=6 {{(pid=117563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 23:09:02.082390 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-716b2ad2-0979-4ab1-8266-aa9460c72d70 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:09:02.083204 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-716b2ad2-0979-4ab1-8266-aa9460c72d70 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:09:02.084464 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-716b2ad2-0979-4ab1-8266-aa9460c72d70 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:09:02.093775 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-716b2ad2-0979-4ab1-8266-aa9460c72d70 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:09:02.486004 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-716b2ad2-0979-4ab1-8266-aa9460c72d70 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2697aa77265e4f5783f87ffb3d4992b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1423c05c42b14519b401e22e16062781', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:09:02.513364 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-716b2ad2-0979-4ab1-8266-aa9460c72d70 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] 10.222.0.17 "GET /compute/v2.1/servers/6fe2cc96-6822-4aa3-9dbf-169d3a688f3a" status: 200 len: 1265 microversion: 2.1 time: 0.447797 Jun 16 23:09:02.516074 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 505/1023] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:09:02 2022] GET /compute/v2.1/servers/6fe2cc96-6822-4aa3-9dbf-169d3a688f3a => generated 1265 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:09:03.533990 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-0ef4767a-47d2-47c8-9b7a-94ca92c56a6d tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:09:03.534631 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-0ef4767a-47d2-47c8-9b7a-94ca92c56a6d tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] [instance: 6fe2cc96-6822-4aa3-9dbf-169d3a688f3a] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:09:03.546257 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG dbcounter [-] [117562] Writing DB stats nova_cell0:SELECT=2 {{(pid=117562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 23:09:03.551795 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-0ef4767a-47d2-47c8-9b7a-94ca92c56a6d tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:09:03.552602 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-0ef4767a-47d2-47c8-9b7a-94ca92c56a6d tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:09:03.553676 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-0ef4767a-47d2-47c8-9b7a-94ca92c56a6d tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:09:03.554226 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-0ef4767a-47d2-47c8-9b7a-94ca92c56a6d tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:09:03.799944 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-0ef4767a-47d2-47c8-9b7a-94ca92c56a6d tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2697aa77265e4f5783f87ffb3d4992b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1423c05c42b14519b401e22e16062781', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:09:03.816401 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-0ef4767a-47d2-47c8-9b7a-94ca92c56a6d tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] 10.222.0.17 "GET /compute/v2.1/servers/6fe2cc96-6822-4aa3-9dbf-169d3a688f3a" status: 200 len: 1265 microversion: 2.1 time: 0.288288 Jun 16 23:09:03.817614 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 519/1024] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:09:03 2022] GET /compute/v2.1/servers/6fe2cc96-6822-4aa3-9dbf-169d3a688f3a => generated 1265 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:09:04.833788 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-cacd5552-30ff-4b23-8387-fdc53b20d1b2 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:09:04.834398 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-cacd5552-30ff-4b23-8387-fdc53b20d1b2 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] [instance: 6fe2cc96-6822-4aa3-9dbf-169d3a688f3a] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:09:04.846714 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-cacd5552-30ff-4b23-8387-fdc53b20d1b2 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:09:04.847527 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-cacd5552-30ff-4b23-8387-fdc53b20d1b2 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:09:04.848425 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-cacd5552-30ff-4b23-8387-fdc53b20d1b2 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:09:04.848939 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-cacd5552-30ff-4b23-8387-fdc53b20d1b2 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:09:04.999889 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-cacd5552-30ff-4b23-8387-fdc53b20d1b2 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2697aa77265e4f5783f87ffb3d4992b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1423c05c42b14519b401e22e16062781', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:09:05.010172 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-cacd5552-30ff-4b23-8387-fdc53b20d1b2 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] 10.222.0.17 "GET /compute/v2.1/servers/6fe2cc96-6822-4aa3-9dbf-169d3a688f3a" status: 200 len: 1265 microversion: 2.1 time: 0.180668 Jun 16 23:09:05.010827 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 506/1025] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:09:04 2022] GET /compute/v2.1/servers/6fe2cc96-6822-4aa3-9dbf-169d3a688f3a => generated 1265 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:09:06.026890 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-289b8868-088b-4b30-97ff-df14c33fabf1 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:09:06.027653 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-289b8868-088b-4b30-97ff-df14c33fabf1 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] [instance: 6fe2cc96-6822-4aa3-9dbf-169d3a688f3a] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:09:06.034980 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-289b8868-088b-4b30-97ff-df14c33fabf1 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:09:06.035672 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-289b8868-088b-4b30-97ff-df14c33fabf1 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:09:06.036881 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-289b8868-088b-4b30-97ff-df14c33fabf1 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:09:06.037687 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-289b8868-088b-4b30-97ff-df14c33fabf1 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:09:06.202810 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-289b8868-088b-4b30-97ff-df14c33fabf1 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2697aa77265e4f5783f87ffb3d4992b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1423c05c42b14519b401e22e16062781', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:09:06.217981 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-289b8868-088b-4b30-97ff-df14c33fabf1 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] 10.222.0.17 "GET /compute/v2.1/servers/6fe2cc96-6822-4aa3-9dbf-169d3a688f3a" status: 200 len: 1265 microversion: 2.1 time: 0.195306 Jun 16 23:09:06.227061 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 520/1026] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:09:06 2022] GET /compute/v2.1/servers/6fe2cc96-6822-4aa3-9dbf-169d3a688f3a => generated 1265 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:09:07.236211 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-17ce11f1-c707-4693-ad3f-5c92aa8e1b08 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:09:07.236838 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-17ce11f1-c707-4693-ad3f-5c92aa8e1b08 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] [instance: 6fe2cc96-6822-4aa3-9dbf-169d3a688f3a] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:09:07.244075 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-17ce11f1-c707-4693-ad3f-5c92aa8e1b08 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:09:07.244528 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-17ce11f1-c707-4693-ad3f-5c92aa8e1b08 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:09:07.245337 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-17ce11f1-c707-4693-ad3f-5c92aa8e1b08 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:09:07.245780 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-17ce11f1-c707-4693-ad3f-5c92aa8e1b08 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:09:07.458070 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-17ce11f1-c707-4693-ad3f-5c92aa8e1b08 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2697aa77265e4f5783f87ffb3d4992b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1423c05c42b14519b401e22e16062781', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:09:07.466581 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-17ce11f1-c707-4693-ad3f-5c92aa8e1b08 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] 10.222.0.17 "GET /compute/v2.1/servers/6fe2cc96-6822-4aa3-9dbf-169d3a688f3a" status: 200 len: 1265 microversion: 2.1 time: 0.235555 Jun 16 23:09:07.469990 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 507/1027] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:09:07 2022] GET /compute/v2.1/servers/6fe2cc96-6822-4aa3-9dbf-169d3a688f3a => generated 1265 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:09:08.486970 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-517cdbf8-c81e-4e89-baee-a28e7756b8b7 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:09:08.487580 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-517cdbf8-c81e-4e89-baee-a28e7756b8b7 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] [instance: 6fe2cc96-6822-4aa3-9dbf-169d3a688f3a] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:09:08.494695 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-517cdbf8-c81e-4e89-baee-a28e7756b8b7 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:09:08.495370 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-517cdbf8-c81e-4e89-baee-a28e7756b8b7 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:09:08.496144 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-517cdbf8-c81e-4e89-baee-a28e7756b8b7 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:09:08.496631 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-517cdbf8-c81e-4e89-baee-a28e7756b8b7 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:09:08.640055 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-517cdbf8-c81e-4e89-baee-a28e7756b8b7 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2697aa77265e4f5783f87ffb3d4992b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1423c05c42b14519b401e22e16062781', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:09:08.648841 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-517cdbf8-c81e-4e89-baee-a28e7756b8b7 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] 10.222.0.17 "GET /compute/v2.1/servers/6fe2cc96-6822-4aa3-9dbf-169d3a688f3a" status: 200 len: 1265 microversion: 2.1 time: 0.165656 Jun 16 23:09:08.658818 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 521/1028] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:09:08 2022] GET /compute/v2.1/servers/6fe2cc96-6822-4aa3-9dbf-169d3a688f3a => generated 1265 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:09:09.665380 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-8a67686d-f1eb-48bf-bc80-ab4912381849 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:09:09.665989 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-8a67686d-f1eb-48bf-bc80-ab4912381849 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] [instance: 6fe2cc96-6822-4aa3-9dbf-169d3a688f3a] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:09:09.676037 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-8a67686d-f1eb-48bf-bc80-ab4912381849 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:09:09.676598 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-8a67686d-f1eb-48bf-bc80-ab4912381849 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:09:09.677448 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-8a67686d-f1eb-48bf-bc80-ab4912381849 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:09:09.677956 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-8a67686d-f1eb-48bf-bc80-ab4912381849 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:09:09.826155 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-8a67686d-f1eb-48bf-bc80-ab4912381849 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2697aa77265e4f5783f87ffb3d4992b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1423c05c42b14519b401e22e16062781', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:09:09.834800 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-8a67686d-f1eb-48bf-bc80-ab4912381849 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] 10.222.0.17 "GET /compute/v2.1/servers/6fe2cc96-6822-4aa3-9dbf-169d3a688f3a" status: 200 len: 1265 microversion: 2.1 time: 0.173326 Jun 16 23:09:09.835447 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 508/1029] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:09:09 2022] GET /compute/v2.1/servers/6fe2cc96-6822-4aa3-9dbf-169d3a688f3a => generated 1265 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:09:10.851470 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-bd827c1e-2976-49b9-ad27-434d470c687a tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:09:10.852869 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-bd827c1e-2976-49b9-ad27-434d470c687a tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] [instance: 6fe2cc96-6822-4aa3-9dbf-169d3a688f3a] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:09:10.860482 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-bd827c1e-2976-49b9-ad27-434d470c687a tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:09:10.861278 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-bd827c1e-2976-49b9-ad27-434d470c687a tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:09:10.862323 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-bd827c1e-2976-49b9-ad27-434d470c687a tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:09:10.862862 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-bd827c1e-2976-49b9-ad27-434d470c687a tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:09:11.017468 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-bd827c1e-2976-49b9-ad27-434d470c687a tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2697aa77265e4f5783f87ffb3d4992b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1423c05c42b14519b401e22e16062781', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:09:11.025760 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-bd827c1e-2976-49b9-ad27-434d470c687a tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] 10.222.0.17 "GET /compute/v2.1/servers/6fe2cc96-6822-4aa3-9dbf-169d3a688f3a" status: 200 len: 1265 microversion: 2.1 time: 0.178190 Jun 16 23:09:11.035180 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 522/1030] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:09:10 2022] GET /compute/v2.1/servers/6fe2cc96-6822-4aa3-9dbf-169d3a688f3a => generated 1265 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:09:12.042866 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-b9444589-6ea7-4a38-95c8-d0b96f9aac4c tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:09:12.044174 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-b9444589-6ea7-4a38-95c8-d0b96f9aac4c tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] [instance: 6fe2cc96-6822-4aa3-9dbf-169d3a688f3a] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:09:12.052992 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-b9444589-6ea7-4a38-95c8-d0b96f9aac4c tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:09:12.053462 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-b9444589-6ea7-4a38-95c8-d0b96f9aac4c tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:09:12.054258 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-b9444589-6ea7-4a38-95c8-d0b96f9aac4c tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:09:12.054738 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-b9444589-6ea7-4a38-95c8-d0b96f9aac4c tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:09:12.207358 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-b9444589-6ea7-4a38-95c8-d0b96f9aac4c tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2697aa77265e4f5783f87ffb3d4992b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1423c05c42b14519b401e22e16062781', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:09:12.225013 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-b9444589-6ea7-4a38-95c8-d0b96f9aac4c tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] 10.222.0.17 "GET /compute/v2.1/servers/6fe2cc96-6822-4aa3-9dbf-169d3a688f3a" status: 200 len: 1265 microversion: 2.1 time: 0.186259 Jun 16 23:09:12.225917 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 509/1031] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:09:12 2022] GET /compute/v2.1/servers/6fe2cc96-6822-4aa3-9dbf-169d3a688f3a => generated 1265 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:09:12.549279 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [req-155ebc49-2ab4-4773-b601-257edddb5aca req-5c95ac2f-4c9b-4f63-9303-05ea44ebbc16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6fe2cc96-6822-4aa3-9dbf-169d3a688f3a", "name": "network-vif-plugged", "status": "completed", "tag": "3d02cfeb-d784-4f09-9198-cae370fc9285"}]} {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 23:09:12.559153 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [req-155ebc49-2ab4-4773-b601-257edddb5aca req-5c95ac2f-4c9b-4f63-9303-05ea44ebbc16 service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:09:12.559890 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [req-155ebc49-2ab4-4773-b601-257edddb5aca req-5c95ac2f-4c9b-4f63-9303-05ea44ebbc16 service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:09:12.575100 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.compute.server_external_events [req-155ebc49-2ab4-4773-b601-257edddb5aca req-5c95ac2f-4c9b-4f63-9303-05ea44ebbc16 service nova] Creating event network-vif-plugged:3d02cfeb-d784-4f09-9198-cae370fc9285 for instance 6fe2cc96-6822-4aa3-9dbf-169d3a688f3a on hv-cinder-84623 Jun 16 23:09:12.581002 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [req-155ebc49-2ab4-4773-b601-257edddb5aca req-5c95ac2f-4c9b-4f63-9303-05ea44ebbc16 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035972 Jun 16 23:09:12.582170 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 523/1032] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 23:09:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 23:09:13.222048 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-916d176d-af78-4e50-a289-1674ba22a1f1 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Action: 'create', calling method: .version_select at 0x7f5320089700>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-653878578", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO+qhQ82zK3PMu2DeMRVFU6muhrdijHVLgYpO8Oo/hWx9u3iIPye1wn/tydJ2mpkgJg+aV3XylWkYwVkIddWSHFVUH1qBYctul8ulx45Vp3aIPlGUxEmEYTZ2MNk0Xqq7A=="}} {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 23:09:13.236219 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.quota [None req-916d176d-af78-4e50-a289-1674ba22a1f1 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Getting quotas for project 09a5ddeaa2ee4af483bd6a59a2900cf7. Resources: {'key_pairs'} {{(pid=117563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 23:09:13.240031 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.quota [None req-916d176d-af78-4e50-a289-1674ba22a1f1 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Getting quotas for user 4e3d0c2fd023474bb0e4e2df0b14a12c and project 09a5ddeaa2ee4af483bd6a59a2900cf7. Resources: {'key_pairs'} {{(pid=117563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 23:09:13.243927 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-bb266851-45b9-42fd-a82a-2ecb4ad300fa tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:09:13.244621 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-bb266851-45b9-42fd-a82a-2ecb4ad300fa tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] [instance: 6fe2cc96-6822-4aa3-9dbf-169d3a688f3a] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:09:13.251899 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-bb266851-45b9-42fd-a82a-2ecb4ad300fa tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:09:13.252360 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-bb266851-45b9-42fd-a82a-2ecb4ad300fa tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:09:13.253145 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-bb266851-45b9-42fd-a82a-2ecb4ad300fa tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:09:13.253571 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-bb266851-45b9-42fd-a82a-2ecb4ad300fa tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:09:13.262440 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-916d176d-af78-4e50-a289-1674ba22a1f1 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.044765 Jun 16 23:09:13.263063 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 510/1033] 10.222.0.17 () {60 vars in 1158 bytes} [Thu Jun 16 23:09:13 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 23:09:13.360650 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-61125514-1c46-4c6a-b950-4f896b3b26c6 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-63856636", "imageRef": "664e3c1d-2b5c-421a-80c8-e60df88c531a", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-653878578", "networks": [{"uuid": "3bc5bb13-5863-4991-9013-5a5018248221"}]}} {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 23:09:13.383471 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-bb266851-45b9-42fd-a82a-2ecb4ad300fa tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2697aa77265e4f5783f87ffb3d4992b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1423c05c42b14519b401e22e16062781', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:09:13.392243 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-bb266851-45b9-42fd-a82a-2ecb4ad300fa tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] 10.222.0.17 "GET /compute/v2.1/servers/6fe2cc96-6822-4aa3-9dbf-169d3a688f3a" status: 200 len: 1265 microversion: 2.1 time: 0.152372 Jun 16 23:09:13.392801 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 524/1034] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:09:13 2022] GET /compute/v2.1/servers/6fe2cc96-6822-4aa3-9dbf-169d3a688f3a => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 23:09:13.411319 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.network.neutron [None req-61125514-1c46-4c6a-b950-4f896b3b26c6 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] validate_networks() for [('3bc5bb13-5863-4991-9013-5a5018248221', None, None, None, None, None)] {{(pid=117563) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 23:09:14.038448 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.virt.hardware [None req-61125514-1c46-4c6a-b950-4f896b3b26c6 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Flavor limits 0:0:0 {{(pid=117563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 23:09:14.038915 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.virt.hardware [None req-61125514-1c46-4c6a-b950-4f896b3b26c6 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Image limits 0:0:0 {{(pid=117563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 23:09:14.039378 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.virt.hardware [None req-61125514-1c46-4c6a-b950-4f896b3b26c6 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Flavor pref 0:0:0 {{(pid=117563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 23:09:14.039783 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.virt.hardware [None req-61125514-1c46-4c6a-b950-4f896b3b26c6 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Image pref 0:0:0 {{(pid=117563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 23:09:14.040223 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.virt.hardware [None req-61125514-1c46-4c6a-b950-4f896b3b26c6 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 23:09:14.049571 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-61125514-1c46-4c6a-b950-4f896b3b26c6 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:09:14.050013 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-61125514-1c46-4c6a-b950-4f896b3b26c6 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:09:14.050835 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-61125514-1c46-4c6a-b950-4f896b3b26c6 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:09:14.051266 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-61125514-1c46-4c6a-b950-4f896b3b26c6 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:09:14.067934 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.quota [None req-61125514-1c46-4c6a-b950-4f896b3b26c6 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Getting quotas for project 09a5ddeaa2ee4af483bd6a59a2900cf7. Resources: {'instances', 'cores', 'ram'} {{(pid=117563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 23:09:14.072003 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.quota [None req-61125514-1c46-4c6a-b950-4f896b3b26c6 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Getting quotas for user 4e3d0c2fd023474bb0e4e2df0b14a12c and project 09a5ddeaa2ee4af483bd6a59a2900cf7. Resources: {'instances', 'cores', 'ram'} {{(pid=117563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 23:09:14.082791 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-61125514-1c46-4c6a-b950-4f896b3b26c6 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Going to run 1 instances... {{(pid=117563) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 23:09:14.084969 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-61125514-1c46-4c6a-b950-4f896b3b26c6 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] [instance: 1838efcc-2f09-4596-927e-3b74d8c48810] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='664e3c1d-2b5c-421a-80c8-e60df88c531a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117563) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 23:09:14.133128 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-61125514-1c46-4c6a-b950-4f896b3b26c6 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.776504 Jun 16 23:09:14.133873 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 511/1035] 10.222.0.17 () {60 vars in 1146 bytes} [Thu Jun 16 23:09:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 778 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 16 23:09:14.143646 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-65ace600-c2e8-4acd-a064-6e702462c983 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:09:14.144379 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-65ace600-c2e8-4acd-a064-6e702462c983 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] [instance: 1838efcc-2f09-4596-927e-3b74d8c48810] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:09:14.199831 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-65ace600-c2e8-4acd-a064-6e702462c983 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d0c2fd023474bb0e4e2df0b14a12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a5ddeaa2ee4af483bd6a59a2900cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:09:14.206418 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-65ace600-c2e8-4acd-a064-6e702462c983 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] 10.222.0.17 "GET /compute/v2.1/servers/1838efcc-2f09-4596-927e-3b74d8c48810" status: 200 len: 1256 microversion: 2.1 time: 0.066483 Jun 16 23:09:14.207191 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 525/1036] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:09:14 2022] GET /compute/v2.1/servers/1838efcc-2f09-4596-927e-3b74d8c48810 => generated 1256 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:09:14.409794 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-7f9e2b64-9a2c-4934-83ff-a1e6d4532150 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:09:14.410569 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-7f9e2b64-9a2c-4934-83ff-a1e6d4532150 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] [instance: 6fe2cc96-6822-4aa3-9dbf-169d3a688f3a] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:09:14.416630 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-7f9e2b64-9a2c-4934-83ff-a1e6d4532150 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:09:14.417081 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-7f9e2b64-9a2c-4934-83ff-a1e6d4532150 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:09:14.418052 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-7f9e2b64-9a2c-4934-83ff-a1e6d4532150 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:09:14.418584 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-7f9e2b64-9a2c-4934-83ff-a1e6d4532150 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:09:14.557423 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-7f9e2b64-9a2c-4934-83ff-a1e6d4532150 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2697aa77265e4f5783f87ffb3d4992b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1423c05c42b14519b401e22e16062781', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:09:14.565126 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-7f9e2b64-9a2c-4934-83ff-a1e6d4532150 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] 10.222.0.17 "GET /compute/v2.1/servers/6fe2cc96-6822-4aa3-9dbf-169d3a688f3a" status: 200 len: 1452 microversion: 2.1 time: 0.160623 Jun 16 23:09:14.566037 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 512/1037] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:09:14 2022] GET /compute/v2.1/servers/6fe2cc96-6822-4aa3-9dbf-169d3a688f3a => generated 1452 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:09:14.581670 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-046bf699-6696-4350-be93-942c62cab9a1 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:09:14.582415 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-046bf699-6696-4350-be93-942c62cab9a1 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] [instance: 6fe2cc96-6822-4aa3-9dbf-169d3a688f3a] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:09:14.588912 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-046bf699-6696-4350-be93-942c62cab9a1 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:09:14.589433 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-046bf699-6696-4350-be93-942c62cab9a1 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:09:14.590279 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-046bf699-6696-4350-be93-942c62cab9a1 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:09:14.590826 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-046bf699-6696-4350-be93-942c62cab9a1 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:09:14.727194 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-046bf699-6696-4350-be93-942c62cab9a1 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2697aa77265e4f5783f87ffb3d4992b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1423c05c42b14519b401e22e16062781', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:09:14.734934 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-046bf699-6696-4350-be93-942c62cab9a1 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] 10.222.0.17 "GET /compute/v2.1/servers/6fe2cc96-6822-4aa3-9dbf-169d3a688f3a" status: 200 len: 1452 microversion: 2.1 time: 0.157438 Jun 16 23:09:14.735597 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 526/1038] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:09:14 2022] GET /compute/v2.1/servers/6fe2cc96-6822-4aa3-9dbf-169d3a688f3a => generated 1452 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:09:15.224891 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-2b012247-4866-40d5-ac17-8f80eed15a4d tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:09:15.225511 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-2b012247-4866-40d5-ac17-8f80eed15a4d tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] [instance: 1838efcc-2f09-4596-927e-3b74d8c48810] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:09:15.227380 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG dbcounter [-] [117563] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=1,nova_api:INSERT=7 {{(pid=117563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 23:09:15.240027 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-2b012247-4866-40d5-ac17-8f80eed15a4d tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:09:15.240480 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-2b012247-4866-40d5-ac17-8f80eed15a4d tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:09:15.241271 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-2b012247-4866-40d5-ac17-8f80eed15a4d tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:09:15.241853 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-2b012247-4866-40d5-ac17-8f80eed15a4d tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:09:15.247321 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG dbcounter [-] [117563] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 23:09:15.317878 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-2b012247-4866-40d5-ac17-8f80eed15a4d tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d0c2fd023474bb0e4e2df0b14a12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a5ddeaa2ee4af483bd6a59a2900cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:09:15.329014 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-2b012247-4866-40d5-ac17-8f80eed15a4d tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] 10.222.0.17 "GET /compute/v2.1/servers/1838efcc-2f09-4596-927e-3b74d8c48810" status: 200 len: 1314 microversion: 2.1 time: 0.108719 Jun 16 23:09:15.329766 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 513/1039] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:09:15 2022] GET /compute/v2.1/servers/1838efcc-2f09-4596-927e-3b74d8c48810 => generated 1314 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:09:16.349166 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-08aee574-2c60-403b-827a-634412e049cc tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:09:16.350865 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-08aee574-2c60-403b-827a-634412e049cc tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] [instance: 1838efcc-2f09-4596-927e-3b74d8c48810] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:09:16.357265 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG dbcounter [-] [117562] Writing DB stats nova_api:SELECT=39 {{(pid=117562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 23:09:16.360710 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-08aee574-2c60-403b-827a-634412e049cc tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:09:16.361381 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-08aee574-2c60-403b-827a-634412e049cc tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:09:16.362857 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-08aee574-2c60-403b-827a-634412e049cc tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:09:16.363597 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-08aee574-2c60-403b-827a-634412e049cc tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:09:16.397193 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG dbcounter [-] [117562] Writing DB stats nova_cell1:SELECT=79 {{(pid=117562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 23:09:16.452333 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-08aee574-2c60-403b-827a-634412e049cc tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d0c2fd023474bb0e4e2df0b14a12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a5ddeaa2ee4af483bd6a59a2900cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:09:16.462205 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-08aee574-2c60-403b-827a-634412e049cc tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] 10.222.0.17 "GET /compute/v2.1/servers/1838efcc-2f09-4596-927e-3b74d8c48810" status: 200 len: 1314 microversion: 2.1 time: 0.119714 Jun 16 23:09:16.472182 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 527/1040] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:09:16 2022] GET /compute/v2.1/servers/1838efcc-2f09-4596-927e-3b74d8c48810 => generated 1314 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:09:17.401734 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [req-72dac9b7-13fd-46a4-af23-faaeb09a93fd req-c96ee83b-cbf0-4186-aac8-4e5149af0cc3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6fe2cc96-6822-4aa3-9dbf-169d3a688f3a", "tag": "3d02cfeb-d784-4f09-9198-cae370fc9285"}]} {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 23:09:17.412585 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-72dac9b7-13fd-46a4-af23-faaeb09a93fd req-c96ee83b-cbf0-4186-aac8-4e5149af0cc3 service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:09:17.413299 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-72dac9b7-13fd-46a4-af23-faaeb09a93fd req-c96ee83b-cbf0-4186-aac8-4e5149af0cc3 service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:09:17.426228 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.compute.server_external_events [req-72dac9b7-13fd-46a4-af23-faaeb09a93fd req-c96ee83b-cbf0-4186-aac8-4e5149af0cc3 service nova] Creating event network-changed:3d02cfeb-d784-4f09-9198-cae370fc9285 for instance 6fe2cc96-6822-4aa3-9dbf-169d3a688f3a on hv-cinder-84623 Jun 16 23:09:17.431867 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [req-72dac9b7-13fd-46a4-af23-faaeb09a93fd req-c96ee83b-cbf0-4186-aac8-4e5149af0cc3 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033850 Jun 16 23:09:17.432788 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 514/1041] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 23:09:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 23:09:17.480829 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-f03ee977-969c-448a-9555-27789bb13cd5 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:09:17.482473 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-f03ee977-969c-448a-9555-27789bb13cd5 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] [instance: 1838efcc-2f09-4596-927e-3b74d8c48810] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:09:17.495921 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-f03ee977-969c-448a-9555-27789bb13cd5 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:09:17.496758 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-f03ee977-969c-448a-9555-27789bb13cd5 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:09:17.497898 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-f03ee977-969c-448a-9555-27789bb13cd5 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:09:17.498608 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-f03ee977-969c-448a-9555-27789bb13cd5 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:09:17.689947 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-f03ee977-969c-448a-9555-27789bb13cd5 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d0c2fd023474bb0e4e2df0b14a12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a5ddeaa2ee4af483bd6a59a2900cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:09:17.697728 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-f03ee977-969c-448a-9555-27789bb13cd5 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] 10.222.0.17 "GET /compute/v2.1/servers/1838efcc-2f09-4596-927e-3b74d8c48810" status: 200 len: 1356 microversion: 2.1 time: 0.221576 Jun 16 23:09:17.698284 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 528/1042] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:09:17 2022] GET /compute/v2.1/servers/1838efcc-2f09-4596-927e-3b74d8c48810 => generated 1356 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:09:18.715633 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-3437b5e2-1ac0-4756-9f24-b4f60fd894d4 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:09:18.716280 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-3437b5e2-1ac0-4756-9f24-b4f60fd894d4 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] [instance: 1838efcc-2f09-4596-927e-3b74d8c48810] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:09:18.722748 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-3437b5e2-1ac0-4756-9f24-b4f60fd894d4 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:09:18.723555 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-3437b5e2-1ac0-4756-9f24-b4f60fd894d4 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:09:18.724629 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-3437b5e2-1ac0-4756-9f24-b4f60fd894d4 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:09:18.725068 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-3437b5e2-1ac0-4756-9f24-b4f60fd894d4 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:09:18.866006 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-3437b5e2-1ac0-4756-9f24-b4f60fd894d4 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d0c2fd023474bb0e4e2df0b14a12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a5ddeaa2ee4af483bd6a59a2900cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:09:18.873790 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-3437b5e2-1ac0-4756-9f24-b4f60fd894d4 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] 10.222.0.17 "GET /compute/v2.1/servers/1838efcc-2f09-4596-927e-3b74d8c48810" status: 200 len: 1356 microversion: 2.1 time: 0.162827 Jun 16 23:09:18.874990 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 515/1043] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:09:18 2022] GET /compute/v2.1/servers/1838efcc-2f09-4596-927e-3b74d8c48810 => generated 1356 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:09:19.892047 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-ba989c59-a816-4a5e-b74e-fe8b95c3bbda tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:09:19.892687 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-ba989c59-a816-4a5e-b74e-fe8b95c3bbda tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] [instance: 1838efcc-2f09-4596-927e-3b74d8c48810] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:09:19.899307 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-ba989c59-a816-4a5e-b74e-fe8b95c3bbda tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:09:19.899762 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-ba989c59-a816-4a5e-b74e-fe8b95c3bbda tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:09:19.900561 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-ba989c59-a816-4a5e-b74e-fe8b95c3bbda tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:09:19.900987 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-ba989c59-a816-4a5e-b74e-fe8b95c3bbda tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:09:20.036103 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-ba989c59-a816-4a5e-b74e-fe8b95c3bbda tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d0c2fd023474bb0e4e2df0b14a12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a5ddeaa2ee4af483bd6a59a2900cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:09:20.044138 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-ba989c59-a816-4a5e-b74e-fe8b95c3bbda tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] 10.222.0.17 "GET /compute/v2.1/servers/1838efcc-2f09-4596-927e-3b74d8c48810" status: 200 len: 1356 microversion: 2.1 time: 0.156481 Jun 16 23:09:20.044642 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 529/1044] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:09:19 2022] GET /compute/v2.1/servers/1838efcc-2f09-4596-927e-3b74d8c48810 => generated 1356 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:09:21.061207 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-24ec543a-172c-451b-8ac8-09d01cd73ead tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:09:21.061918 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-24ec543a-172c-451b-8ac8-09d01cd73ead tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] [instance: 1838efcc-2f09-4596-927e-3b74d8c48810] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:09:21.068535 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-24ec543a-172c-451b-8ac8-09d01cd73ead tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:09:21.068985 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-24ec543a-172c-451b-8ac8-09d01cd73ead tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:09:21.069874 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-24ec543a-172c-451b-8ac8-09d01cd73ead tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:09:21.070320 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-24ec543a-172c-451b-8ac8-09d01cd73ead tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:09:21.210488 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-24ec543a-172c-451b-8ac8-09d01cd73ead tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d0c2fd023474bb0e4e2df0b14a12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a5ddeaa2ee4af483bd6a59a2900cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:09:21.219103 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-24ec543a-172c-451b-8ac8-09d01cd73ead tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] 10.222.0.17 "GET /compute/v2.1/servers/1838efcc-2f09-4596-927e-3b74d8c48810" status: 200 len: 1356 microversion: 2.1 time: 0.161572 Jun 16 23:09:21.219798 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 516/1045] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:09:21 2022] GET /compute/v2.1/servers/1838efcc-2f09-4596-927e-3b74d8c48810 => generated 1356 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:09:22.241246 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-f7445d47-36ae-4a5f-935d-05467aea1ed1 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:09:22.242098 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-f7445d47-36ae-4a5f-935d-05467aea1ed1 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] [instance: 1838efcc-2f09-4596-927e-3b74d8c48810] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:09:22.249954 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-f7445d47-36ae-4a5f-935d-05467aea1ed1 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:09:22.250506 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-f7445d47-36ae-4a5f-935d-05467aea1ed1 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:09:22.251403 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-f7445d47-36ae-4a5f-935d-05467aea1ed1 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:09:22.251937 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-f7445d47-36ae-4a5f-935d-05467aea1ed1 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:09:22.406681 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-f7445d47-36ae-4a5f-935d-05467aea1ed1 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d0c2fd023474bb0e4e2df0b14a12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a5ddeaa2ee4af483bd6a59a2900cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:09:22.414359 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-f7445d47-36ae-4a5f-935d-05467aea1ed1 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] 10.222.0.17 "GET /compute/v2.1/servers/1838efcc-2f09-4596-927e-3b74d8c48810" status: 200 len: 1356 microversion: 2.1 time: 0.180621 Jun 16 23:09:22.415230 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 530/1046] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:09:22 2022] GET /compute/v2.1/servers/1838efcc-2f09-4596-927e-3b74d8c48810 => generated 1356 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:09:23.431915 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-20a2e04b-f5e6-41a0-9d72-deefd0375047 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:09:23.433683 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-20a2e04b-f5e6-41a0-9d72-deefd0375047 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] [instance: 1838efcc-2f09-4596-927e-3b74d8c48810] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:09:23.443462 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-20a2e04b-f5e6-41a0-9d72-deefd0375047 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:09:23.444176 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-20a2e04b-f5e6-41a0-9d72-deefd0375047 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:09:23.445182 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-20a2e04b-f5e6-41a0-9d72-deefd0375047 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:09:23.448888 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-20a2e04b-f5e6-41a0-9d72-deefd0375047 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:09:23.678899 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-20a2e04b-f5e6-41a0-9d72-deefd0375047 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d0c2fd023474bb0e4e2df0b14a12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a5ddeaa2ee4af483bd6a59a2900cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:09:23.683130 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [req-18398fc3-b63e-44e7-89cc-a506a470d906 req-80bec528-30dc-47ca-b2f5-1dcd3f9bef79 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1838efcc-2f09-4596-927e-3b74d8c48810", "tag": "61b8124a-070e-4798-ac19-c08840a62cf5"}]} {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 23:09:23.691742 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-20a2e04b-f5e6-41a0-9d72-deefd0375047 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] 10.222.0.17 "GET /compute/v2.1/servers/1838efcc-2f09-4596-927e-3b74d8c48810" status: 200 len: 1356 microversion: 2.1 time: 0.263628 Jun 16 23:09:23.692311 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 517/1047] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:09:23 2022] GET /compute/v2.1/servers/1838efcc-2f09-4596-927e-3b74d8c48810 => generated 1356 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 23:09:23.701688 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [req-18398fc3-b63e-44e7-89cc-a506a470d906 req-80bec528-30dc-47ca-b2f5-1dcd3f9bef79 service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:09:23.702283 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [req-18398fc3-b63e-44e7-89cc-a506a470d906 req-80bec528-30dc-47ca-b2f5-1dcd3f9bef79 service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:09:23.717722 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.compute.server_external_events [req-18398fc3-b63e-44e7-89cc-a506a470d906 req-80bec528-30dc-47ca-b2f5-1dcd3f9bef79 service nova] Creating event network-changed:61b8124a-070e-4798-ac19-c08840a62cf5 for instance 1838efcc-2f09-4596-927e-3b74d8c48810 on hv-cinder-84623 Jun 16 23:09:23.723563 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [req-18398fc3-b63e-44e7-89cc-a506a470d906 req-80bec528-30dc-47ca-b2f5-1dcd3f9bef79 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055623 Jun 16 23:09:23.724161 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 531/1048] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 23:09:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 23:09:24.709006 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-31ef7b99-57e3-4ade-9807-56a7a94b6103 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:09:24.709612 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-31ef7b99-57e3-4ade-9807-56a7a94b6103 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] [instance: 1838efcc-2f09-4596-927e-3b74d8c48810] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:09:24.711541 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG dbcounter [-] [117563] Writing DB stats nova_cell0:SELECT=2 {{(pid=117563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 23:09:24.712275 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG dbcounter [-] [117563] Writing DB stats nova_cell0:SELECT=10 {{(pid=117563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 23:09:24.718468 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-31ef7b99-57e3-4ade-9807-56a7a94b6103 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:09:24.718942 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-31ef7b99-57e3-4ade-9807-56a7a94b6103 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:09:24.719700 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-31ef7b99-57e3-4ade-9807-56a7a94b6103 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:09:24.720133 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-31ef7b99-57e3-4ade-9807-56a7a94b6103 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:09:24.847084 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-31ef7b99-57e3-4ade-9807-56a7a94b6103 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d0c2fd023474bb0e4e2df0b14a12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a5ddeaa2ee4af483bd6a59a2900cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:09:24.854560 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-31ef7b99-57e3-4ade-9807-56a7a94b6103 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] 10.222.0.17 "GET /compute/v2.1/servers/1838efcc-2f09-4596-927e-3b74d8c48810" status: 200 len: 1356 microversion: 2.1 time: 0.149330 Jun 16 23:09:24.855132 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 518/1049] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:09:24 2022] GET /compute/v2.1/servers/1838efcc-2f09-4596-927e-3b74d8c48810 => generated 1356 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:09:25.868856 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG dbcounter [-] [117562] Writing DB stats nova_cell0:SELECT=2 {{(pid=117562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 23:09:25.873837 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-c33e8861-d465-4062-8117-ffdbea01dc86 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:09:25.874523 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-c33e8861-d465-4062-8117-ffdbea01dc86 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] [instance: 1838efcc-2f09-4596-927e-3b74d8c48810] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:09:25.881009 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-c33e8861-d465-4062-8117-ffdbea01dc86 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:09:25.881456 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-c33e8861-d465-4062-8117-ffdbea01dc86 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:09:25.882216 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-c33e8861-d465-4062-8117-ffdbea01dc86 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:09:25.882690 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-c33e8861-d465-4062-8117-ffdbea01dc86 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:09:26.008247 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-c33e8861-d465-4062-8117-ffdbea01dc86 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d0c2fd023474bb0e4e2df0b14a12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a5ddeaa2ee4af483bd6a59a2900cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:09:26.016238 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-c33e8861-d465-4062-8117-ffdbea01dc86 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] 10.222.0.17 "GET /compute/v2.1/servers/1838efcc-2f09-4596-927e-3b74d8c48810" status: 200 len: 1356 microversion: 2.1 time: 0.147697 Jun 16 23:09:26.016814 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 532/1050] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:09:25 2022] GET /compute/v2.1/servers/1838efcc-2f09-4596-927e-3b74d8c48810 => generated 1356 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:09:27.033317 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-9ccfacef-9615-4111-9769-d84dd63f0ef9 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:09:27.034051 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-9ccfacef-9615-4111-9769-d84dd63f0ef9 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] [instance: 1838efcc-2f09-4596-927e-3b74d8c48810] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:09:27.040350 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-9ccfacef-9615-4111-9769-d84dd63f0ef9 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:09:27.040808 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-9ccfacef-9615-4111-9769-d84dd63f0ef9 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:09:27.041576 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-9ccfacef-9615-4111-9769-d84dd63f0ef9 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:09:27.042014 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-9ccfacef-9615-4111-9769-d84dd63f0ef9 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:09:27.169258 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-9ccfacef-9615-4111-9769-d84dd63f0ef9 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d0c2fd023474bb0e4e2df0b14a12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a5ddeaa2ee4af483bd6a59a2900cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:09:27.176604 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-9ccfacef-9615-4111-9769-d84dd63f0ef9 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] 10.222.0.17 "GET /compute/v2.1/servers/1838efcc-2f09-4596-927e-3b74d8c48810" status: 200 len: 1356 microversion: 2.1 time: 0.147663 Jun 16 23:09:27.177167 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 519/1051] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:09:27 2022] GET /compute/v2.1/servers/1838efcc-2f09-4596-927e-3b74d8c48810 => generated 1356 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:09:28.194212 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-ca262ea6-e6cf-4e76-80c0-ef376d1d80c5 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:09:28.194840 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-ca262ea6-e6cf-4e76-80c0-ef376d1d80c5 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] [instance: 1838efcc-2f09-4596-927e-3b74d8c48810] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:09:28.201294 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-ca262ea6-e6cf-4e76-80c0-ef376d1d80c5 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:09:28.201741 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-ca262ea6-e6cf-4e76-80c0-ef376d1d80c5 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:09:28.202494 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-ca262ea6-e6cf-4e76-80c0-ef376d1d80c5 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:09:28.203089 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-ca262ea6-e6cf-4e76-80c0-ef376d1d80c5 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:09:28.331443 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-ca262ea6-e6cf-4e76-80c0-ef376d1d80c5 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d0c2fd023474bb0e4e2df0b14a12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a5ddeaa2ee4af483bd6a59a2900cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:09:28.338775 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-ca262ea6-e6cf-4e76-80c0-ef376d1d80c5 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] 10.222.0.17 "GET /compute/v2.1/servers/1838efcc-2f09-4596-927e-3b74d8c48810" status: 200 len: 1356 microversion: 2.1 time: 0.148348 Jun 16 23:09:28.339319 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 533/1052] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:09:28 2022] GET /compute/v2.1/servers/1838efcc-2f09-4596-927e-3b74d8c48810 => generated 1356 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:09:28.579801 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [req-6c6787b3-1426-48e7-9ca0-aec95679d90b req-ed0cf50e-11cf-42ca-9173-5ef1793b8f05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1838efcc-2f09-4596-927e-3b74d8c48810", "name": "network-vif-plugged", "status": "completed", "tag": "61b8124a-070e-4798-ac19-c08840a62cf5"}]} {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 23:09:28.588338 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-6c6787b3-1426-48e7-9ca0-aec95679d90b req-ed0cf50e-11cf-42ca-9173-5ef1793b8f05 service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:09:28.588836 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-6c6787b3-1426-48e7-9ca0-aec95679d90b req-ed0cf50e-11cf-42ca-9173-5ef1793b8f05 service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:09:28.601424 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.compute.server_external_events [req-6c6787b3-1426-48e7-9ca0-aec95679d90b req-ed0cf50e-11cf-42ca-9173-5ef1793b8f05 service nova] Creating event network-vif-plugged:61b8124a-070e-4798-ac19-c08840a62cf5 for instance 1838efcc-2f09-4596-927e-3b74d8c48810 on hv-cinder-84623 Jun 16 23:09:28.606352 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [req-6c6787b3-1426-48e7-9ca0-aec95679d90b req-ed0cf50e-11cf-42ca-9173-5ef1793b8f05 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030769 Jun 16 23:09:28.606979 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 520/1053] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 23:09:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 23:09:29.355940 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-878290f0-6e10-4337-8755-0a8bb00e0c60 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:09:29.356550 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-878290f0-6e10-4337-8755-0a8bb00e0c60 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] [instance: 1838efcc-2f09-4596-927e-3b74d8c48810] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:09:29.363636 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-878290f0-6e10-4337-8755-0a8bb00e0c60 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:09:29.364089 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-878290f0-6e10-4337-8755-0a8bb00e0c60 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:09:29.364860 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-878290f0-6e10-4337-8755-0a8bb00e0c60 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:09:29.365300 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-878290f0-6e10-4337-8755-0a8bb00e0c60 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:09:29.495354 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-878290f0-6e10-4337-8755-0a8bb00e0c60 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d0c2fd023474bb0e4e2df0b14a12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a5ddeaa2ee4af483bd6a59a2900cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:09:29.503714 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-878290f0-6e10-4337-8755-0a8bb00e0c60 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] 10.222.0.17 "GET /compute/v2.1/servers/1838efcc-2f09-4596-927e-3b74d8c48810" status: 200 len: 1356 microversion: 2.1 time: 0.151607 Jun 16 23:09:29.504268 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 534/1054] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:09:29 2022] GET /compute/v2.1/servers/1838efcc-2f09-4596-927e-3b74d8c48810 => generated 1356 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:09:30.522047 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-478057a5-e540-4301-8793-fd1aacf2ba74 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:09:30.522694 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-478057a5-e540-4301-8793-fd1aacf2ba74 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] [instance: 1838efcc-2f09-4596-927e-3b74d8c48810] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:09:30.528908 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-478057a5-e540-4301-8793-fd1aacf2ba74 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:09:30.529360 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-478057a5-e540-4301-8793-fd1aacf2ba74 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:09:30.530126 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-478057a5-e540-4301-8793-fd1aacf2ba74 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:09:30.530566 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-478057a5-e540-4301-8793-fd1aacf2ba74 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:09:30.661527 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-478057a5-e540-4301-8793-fd1aacf2ba74 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d0c2fd023474bb0e4e2df0b14a12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a5ddeaa2ee4af483bd6a59a2900cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:09:30.668857 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-478057a5-e540-4301-8793-fd1aacf2ba74 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] 10.222.0.17 "GET /compute/v2.1/servers/1838efcc-2f09-4596-927e-3b74d8c48810" status: 200 len: 1547 microversion: 2.1 time: 0.151635 Jun 16 23:09:30.669409 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 521/1055] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:09:30 2022] GET /compute/v2.1/servers/1838efcc-2f09-4596-927e-3b74d8c48810 => generated 1547 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:09:30.684500 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-2e1e841d-4ae3-43f8-972c-ac93ee2f34e1 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:09:30.685107 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-2e1e841d-4ae3-43f8-972c-ac93ee2f34e1 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] [instance: 1838efcc-2f09-4596-927e-3b74d8c48810] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:09:30.692288 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-2e1e841d-4ae3-43f8-972c-ac93ee2f34e1 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:09:30.692732 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-2e1e841d-4ae3-43f8-972c-ac93ee2f34e1 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:09:30.693485 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-2e1e841d-4ae3-43f8-972c-ac93ee2f34e1 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:09:30.693918 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-2e1e841d-4ae3-43f8-972c-ac93ee2f34e1 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:09:30.821565 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-2e1e841d-4ae3-43f8-972c-ac93ee2f34e1 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d0c2fd023474bb0e4e2df0b14a12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a5ddeaa2ee4af483bd6a59a2900cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:09:30.828840 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-2e1e841d-4ae3-43f8-972c-ac93ee2f34e1 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] 10.222.0.17 "GET /compute/v2.1/servers/1838efcc-2f09-4596-927e-3b74d8c48810" status: 200 len: 1547 microversion: 2.1 time: 0.148149 Jun 16 23:09:30.829569 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 535/1056] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:09:30 2022] GET /compute/v2.1/servers/1838efcc-2f09-4596-927e-3b74d8c48810 => generated 1547 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:09:30.844091 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-967b3ee9-6689-4fb2-aedc-18b9e789b219 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:09:30.847442 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-967b3ee9-6689-4fb2-aedc-18b9e789b219 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4e3d0c2fd023474bb0e4e2df0b14a12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a5ddeaa2ee4af483bd6a59a2900cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:09:30.848194 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-967b3ee9-6689-4fb2-aedc-18b9e789b219 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Searching by: {'deleted': False, 'project_id': '09a5ddeaa2ee4af483bd6a59a2900cf7'} {{(pid=117563) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 16 23:09:30.854703 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-967b3ee9-6689-4fb2-aedc-18b9e789b219 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:09:30.855144 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-967b3ee9-6689-4fb2-aedc-18b9e789b219 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:09:30.855930 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-967b3ee9-6689-4fb2-aedc-18b9e789b219 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:09:30.856360 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-967b3ee9-6689-4fb2-aedc-18b9e789b219 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:09:30.950131 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.multi_cell_list [None req-967b3ee9-6689-4fb2-aedc-18b9e789b219 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117563) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 16 23:09:31.039295 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-967b3ee9-6689-4fb2-aedc-18b9e789b219 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] 10.222.0.17 "GET /compute/v2.1/servers" status: 200 len: 341 microversion: 2.1 time: 0.198885 Jun 16 23:09:31.039869 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 522/1057] 10.222.0.17 () {58 vars in 1124 bytes} [Thu Jun 16 23:09:30 2022] GET /compute/v2.1/servers => generated 341 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 23:09:31.050371 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-892fd552-758f-4e3c-b20d-a9160777190a tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:09:31.051018 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-892fd552-758f-4e3c-b20d-a9160777190a tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] [instance: 1838efcc-2f09-4596-927e-3b74d8c48810] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:09:31.056998 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-892fd552-758f-4e3c-b20d-a9160777190a tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:09:31.057453 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-892fd552-758f-4e3c-b20d-a9160777190a tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:09:31.058221 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-892fd552-758f-4e3c-b20d-a9160777190a tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:09:31.058699 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-892fd552-758f-4e3c-b20d-a9160777190a tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:09:31.183855 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-892fd552-758f-4e3c-b20d-a9160777190a tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d0c2fd023474bb0e4e2df0b14a12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a5ddeaa2ee4af483bd6a59a2900cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:09:31.192137 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-892fd552-758f-4e3c-b20d-a9160777190a tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] 10.222.0.17 "GET /compute/v2.1/servers/1838efcc-2f09-4596-927e-3b74d8c48810" status: 200 len: 1547 microversion: 2.1 time: 0.146111 Jun 16 23:09:31.192691 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 536/1058] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:09:31 2022] GET /compute/v2.1/servers/1838efcc-2f09-4596-927e-3b74d8c48810 => generated 1547 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:09:32.698260 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-0a89a460-fff7-4cc0-a7ab-22c763f1dbe0 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6e6b0291-e962-452f-a785-f3886cf466b1"}} {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 23:09:32.699569 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-0a89a460-fff7-4cc0-a7ab-22c763f1dbe0 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] [instance: 1838efcc-2f09-4596-927e-3b74d8c48810] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:09:32.706112 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-0a89a460-fff7-4cc0-a7ab-22c763f1dbe0 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:09:32.706555 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-0a89a460-fff7-4cc0-a7ab-22c763f1dbe0 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:09:32.707347 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-0a89a460-fff7-4cc0-a7ab-22c763f1dbe0 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:09:32.707777 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-0a89a460-fff7-4cc0-a7ab-22c763f1dbe0 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:09:32.940222 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-0a89a460-fff7-4cc0-a7ab-22c763f1dbe0 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] 10.222.0.17 "POST /compute/v2.1/servers/1838efcc-2f09-4596-927e-3b74d8c48810/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.245697 Jun 16 23:09:32.940894 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 523/1059] 10.222.0.17 () {60 vars in 1322 bytes} [Thu Jun 16 23:09:32 2022] POST /compute/v2.1/servers/1838efcc-2f09-4596-927e-3b74d8c48810/os-volume_attachments => generated 194 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 23:09:39.419632 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-b4b83123-3bf9-4744-9398-f56e358a11ad tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:09:39.420773 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-b4b83123-3bf9-4744-9398-f56e358a11ad tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] [instance: 1838efcc-2f09-4596-927e-3b74d8c48810] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:09:39.427463 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-b4b83123-3bf9-4744-9398-f56e358a11ad tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:09:39.427914 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-b4b83123-3bf9-4744-9398-f56e358a11ad tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:09:39.428679 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-b4b83123-3bf9-4744-9398-f56e358a11ad tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:09:39.429117 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-b4b83123-3bf9-4744-9398-f56e358a11ad tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:09:39.556100 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-b4b83123-3bf9-4744-9398-f56e358a11ad tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d0c2fd023474bb0e4e2df0b14a12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a5ddeaa2ee4af483bd6a59a2900cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:09:39.564305 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-b4b83123-3bf9-4744-9398-f56e358a11ad tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] 10.222.0.17 "GET /compute/v2.1/servers/1838efcc-2f09-4596-927e-3b74d8c48810" status: 200 len: 1593 microversion: 2.1 time: 0.148478 Jun 16 23:09:39.564867 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 537/1060] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:09:39 2022] GET /compute/v2.1/servers/1838efcc-2f09-4596-927e-3b74d8c48810 => generated 1593 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:09:41.230626 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG dbcounter [-] [117563] Writing DB stats nova_cell0:SELECT=2 {{(pid=117563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 23:09:41.236679 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [req-e588d47e-2ea3-4ad9-bc12-9f81e72f358c req-84181142-073f-4509-8242-4181b6ba5ce7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1838efcc-2f09-4596-927e-3b74d8c48810", "tag": "61b8124a-070e-4798-ac19-c08840a62cf5"}]} {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 23:09:41.245086 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-e588d47e-2ea3-4ad9-bc12-9f81e72f358c req-84181142-073f-4509-8242-4181b6ba5ce7 service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:09:41.245534 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-e588d47e-2ea3-4ad9-bc12-9f81e72f358c req-84181142-073f-4509-8242-4181b6ba5ce7 service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:09:41.258422 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.compute.server_external_events [req-e588d47e-2ea3-4ad9-bc12-9f81e72f358c req-84181142-073f-4509-8242-4181b6ba5ce7 service nova] Creating event network-changed:61b8124a-070e-4798-ac19-c08840a62cf5 for instance 1838efcc-2f09-4596-927e-3b74d8c48810 on hv-cinder-84623 Jun 16 23:09:41.263620 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [req-e588d47e-2ea3-4ad9-bc12-9f81e72f358c req-84181142-073f-4509-8242-4181b6ba5ce7 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034297 Jun 16 23:09:41.264446 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 524/1061] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 23:09:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 23:09:42.399919 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-c7510980-acc5-4a91-ae18-f8034a8ce7ee tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-977519909"}} {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 23:09:42.400489 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-c7510980-acc5-4a91-ae18-f8034a8ce7ee tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] [instance: 1838efcc-2f09-4596-927e-3b74d8c48810] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:09:42.407226 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-c7510980-acc5-4a91-ae18-f8034a8ce7ee tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:09:42.407677 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-c7510980-acc5-4a91-ae18-f8034a8ce7ee tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:09:42.408456 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-c7510980-acc5-4a91-ae18-f8034a8ce7ee tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:09:42.408897 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-c7510980-acc5-4a91-ae18-f8034a8ce7ee tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:09:42.538216 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.network.security_group_api [None req-c7510980-acc5-4a91-ae18-f8034a8ce7ee tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Adding security group 6e747dff-31c5-44d6-82a9-11ae72ddc37b to port 61b8124a-070e-4798-ac19-c08840a62cf5 Jun 16 23:09:42.894088 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-c7510980-acc5-4a91-ae18-f8034a8ce7ee tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] 10.222.0.17 "POST /compute/v2.1/servers/1838efcc-2f09-4596-927e-3b74d8c48810/action" status: 202 len: 0 microversion: 2.1 time: 0.498065 Jun 16 23:09:42.894804 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 538/1062] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Jun 16 23:09:42 2022] POST /compute/v2.1/servers/1838efcc-2f09-4596-927e-3b74d8c48810/action => generated 0 bytes in 500 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 23:09:42.905056 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-4fa6634d-7b38-4284-8420-9d1fc95476d8 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:09:42.907266 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-4fa6634d-7b38-4284-8420-9d1fc95476d8 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] [instance: 1838efcc-2f09-4596-927e-3b74d8c48810] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:09:42.914981 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-4fa6634d-7b38-4284-8420-9d1fc95476d8 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:09:42.916599 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-4fa6634d-7b38-4284-8420-9d1fc95476d8 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:09:42.917632 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-4fa6634d-7b38-4284-8420-9d1fc95476d8 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:09:42.918326 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-4fa6634d-7b38-4284-8420-9d1fc95476d8 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:09:43.107113 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-4fa6634d-7b38-4284-8420-9d1fc95476d8 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d0c2fd023474bb0e4e2df0b14a12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a5ddeaa2ee4af483bd6a59a2900cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:09:43.116476 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-4fa6634d-7b38-4284-8420-9d1fc95476d8 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] 10.222.0.17 "GET /compute/v2.1/servers/1838efcc-2f09-4596-927e-3b74d8c48810" status: 200 len: 1758 microversion: 2.1 time: 0.216683 Jun 16 23:09:43.118238 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 525/1063] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:09:42 2022] GET /compute/v2.1/servers/1838efcc-2f09-4596-927e-3b74d8c48810 => generated 1758 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:09:43.279071 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [req-c4be8b8b-22b1-4c2b-96b2-76c6f5e9e97c req-de1baec4-2011-4301-9652-6403d3bbd3df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1838efcc-2f09-4596-927e-3b74d8c48810", "tag": "61b8124a-070e-4798-ac19-c08840a62cf5"}]} {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 23:09:43.288356 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [req-c4be8b8b-22b1-4c2b-96b2-76c6f5e9e97c req-de1baec4-2011-4301-9652-6403d3bbd3df service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:09:43.300260 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [req-c4be8b8b-22b1-4c2b-96b2-76c6f5e9e97c req-de1baec4-2011-4301-9652-6403d3bbd3df service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:09:43.312657 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.compute.server_external_events [req-c4be8b8b-22b1-4c2b-96b2-76c6f5e9e97c req-de1baec4-2011-4301-9652-6403d3bbd3df service nova] Creating event network-changed:61b8124a-070e-4798-ac19-c08840a62cf5 for instance 1838efcc-2f09-4596-927e-3b74d8c48810 on hv-cinder-84623 Jun 16 23:09:43.318065 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [req-c4be8b8b-22b1-4c2b-96b2-76c6f5e9e97c req-de1baec4-2011-4301-9652-6403d3bbd3df service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043104 Jun 16 23:09:43.318802 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 539/1064] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 23:09:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 23:10:05.645911 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-c36407ad-bb06-4173-a064-3d970b2215e7 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 23:10:05.646959 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-c36407ad-bb06-4173-a064-3d970b2215e7 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] [instance: 1838efcc-2f09-4596-927e-3b74d8c48810] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:10:05.649120 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG dbcounter [-] [117563] Writing DB stats nova_api:SELECT=25 {{(pid=117563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 23:10:05.649778 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG dbcounter [-] [117563] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 23:10:05.656137 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-c36407ad-bb06-4173-a064-3d970b2215e7 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:10:05.656581 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-c36407ad-bb06-4173-a064-3d970b2215e7 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:10:05.657337 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-c36407ad-bb06-4173-a064-3d970b2215e7 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:10:05.657772 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-c36407ad-bb06-4173-a064-3d970b2215e7 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:10:05.730154 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-c36407ad-bb06-4173-a064-3d970b2215e7 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] 10.222.0.17 "POST /compute/v2.1/servers/1838efcc-2f09-4596-927e-3b74d8c48810/action" status: 202 len: 0 microversion: 2.1 time: 0.087895 Jun 16 23:10:05.730837 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 526/1065] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Jun 16 23:10:05 2022] POST /compute/v2.1/servers/1838efcc-2f09-4596-927e-3b74d8c48810/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 23:10:05.736901 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG dbcounter [-] [117562] Writing DB stats nova_api:SELECT=25 {{(pid=117562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 23:10:05.738032 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG dbcounter [-] [117562] Writing DB stats nova_cell1:SELECT=67 {{(pid=117562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 23:10:05.742423 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-d1df31e6-1a28-4877-a51f-90d7825bbfa8 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:10:05.743154 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-d1df31e6-1a28-4877-a51f-90d7825bbfa8 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] [instance: 1838efcc-2f09-4596-927e-3b74d8c48810] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:10:05.751340 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-d1df31e6-1a28-4877-a51f-90d7825bbfa8 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:10:05.751799 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-d1df31e6-1a28-4877-a51f-90d7825bbfa8 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:10:05.752574 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-d1df31e6-1a28-4877-a51f-90d7825bbfa8 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:10:05.753022 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-d1df31e6-1a28-4877-a51f-90d7825bbfa8 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:10:05.904696 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-d1df31e6-1a28-4877-a51f-90d7825bbfa8 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d0c2fd023474bb0e4e2df0b14a12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a5ddeaa2ee4af483bd6a59a2900cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:10:05.912776 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-d1df31e6-1a28-4877-a51f-90d7825bbfa8 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] 10.222.0.17 "GET /compute/v2.1/servers/1838efcc-2f09-4596-927e-3b74d8c48810" status: 200 len: 1750 microversion: 2.1 time: 0.177473 Jun 16 23:10:05.913355 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 540/1066] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:10:05 2022] GET /compute/v2.1/servers/1838efcc-2f09-4596-927e-3b74d8c48810 => generated 1750 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:10:06.930091 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-76e46236-f48a-4af7-ac0a-a2a29e9c6e78 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:10:06.930816 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-76e46236-f48a-4af7-ac0a-a2a29e9c6e78 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] [instance: 1838efcc-2f09-4596-927e-3b74d8c48810] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:10:06.937774 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-76e46236-f48a-4af7-ac0a-a2a29e9c6e78 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:10:06.938253 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-76e46236-f48a-4af7-ac0a-a2a29e9c6e78 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:10:06.939030 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-76e46236-f48a-4af7-ac0a-a2a29e9c6e78 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:10:06.939466 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-76e46236-f48a-4af7-ac0a-a2a29e9c6e78 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:10:07.080737 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-76e46236-f48a-4af7-ac0a-a2a29e9c6e78 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d0c2fd023474bb0e4e2df0b14a12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a5ddeaa2ee4af483bd6a59a2900cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:10:07.088490 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-76e46236-f48a-4af7-ac0a-a2a29e9c6e78 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] 10.222.0.17 "GET /compute/v2.1/servers/1838efcc-2f09-4596-927e-3b74d8c48810" status: 200 len: 1755 microversion: 2.1 time: 0.163053 Jun 16 23:10:07.089051 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 527/1067] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:10:06 2022] GET /compute/v2.1/servers/1838efcc-2f09-4596-927e-3b74d8c48810 => generated 1755 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:10:08.106739 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-f7fc7c29-30e5-48a9-bcf8-e6c394c5b180 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:10:08.107356 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-f7fc7c29-30e5-48a9-bcf8-e6c394c5b180 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] [instance: 1838efcc-2f09-4596-927e-3b74d8c48810] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:10:08.113767 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-f7fc7c29-30e5-48a9-bcf8-e6c394c5b180 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:10:08.114213 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-f7fc7c29-30e5-48a9-bcf8-e6c394c5b180 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:10:08.115009 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-f7fc7c29-30e5-48a9-bcf8-e6c394c5b180 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:10:08.115447 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-f7fc7c29-30e5-48a9-bcf8-e6c394c5b180 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:10:08.256166 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-f7fc7c29-30e5-48a9-bcf8-e6c394c5b180 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d0c2fd023474bb0e4e2df0b14a12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a5ddeaa2ee4af483bd6a59a2900cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:10:08.264417 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-f7fc7c29-30e5-48a9-bcf8-e6c394c5b180 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] 10.222.0.17 "GET /compute/v2.1/servers/1838efcc-2f09-4596-927e-3b74d8c48810" status: 200 len: 1755 microversion: 2.1 time: 0.162095 Jun 16 23:10:08.264977 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 541/1068] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:10:08 2022] GET /compute/v2.1/servers/1838efcc-2f09-4596-927e-3b74d8c48810 => generated 1755 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:10:09.282014 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-1df1073f-b0c2-4dc1-9a35-81965c8a39d8 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:10:09.282644 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-1df1073f-b0c2-4dc1-9a35-81965c8a39d8 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] [instance: 1838efcc-2f09-4596-927e-3b74d8c48810] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:10:09.289084 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-1df1073f-b0c2-4dc1-9a35-81965c8a39d8 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:10:09.289537 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-1df1073f-b0c2-4dc1-9a35-81965c8a39d8 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:10:09.290300 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-1df1073f-b0c2-4dc1-9a35-81965c8a39d8 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:10:09.290767 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-1df1073f-b0c2-4dc1-9a35-81965c8a39d8 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:10:09.426761 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-1df1073f-b0c2-4dc1-9a35-81965c8a39d8 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d0c2fd023474bb0e4e2df0b14a12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a5ddeaa2ee4af483bd6a59a2900cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:10:09.435170 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-1df1073f-b0c2-4dc1-9a35-81965c8a39d8 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] 10.222.0.17 "GET /compute/v2.1/servers/1838efcc-2f09-4596-927e-3b74d8c48810" status: 200 len: 1755 microversion: 2.1 time: 0.156991 Jun 16 23:10:09.435726 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 528/1069] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:10:09 2022] GET /compute/v2.1/servers/1838efcc-2f09-4596-927e-3b74d8c48810 => generated 1755 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:10:10.452628 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-34915b64-830b-4b6a-bb34-bbbecff8da44 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:10:10.453231 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-34915b64-830b-4b6a-bb34-bbbecff8da44 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] [instance: 1838efcc-2f09-4596-927e-3b74d8c48810] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:10:10.459641 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-34915b64-830b-4b6a-bb34-bbbecff8da44 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:10:10.460115 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-34915b64-830b-4b6a-bb34-bbbecff8da44 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:10:10.460870 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-34915b64-830b-4b6a-bb34-bbbecff8da44 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:10:10.461396 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-34915b64-830b-4b6a-bb34-bbbecff8da44 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:10:10.858516 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-34915b64-830b-4b6a-bb34-bbbecff8da44 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d0c2fd023474bb0e4e2df0b14a12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a5ddeaa2ee4af483bd6a59a2900cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:10:10.866384 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-34915b64-830b-4b6a-bb34-bbbecff8da44 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] 10.222.0.17 "GET /compute/v2.1/servers/1838efcc-2f09-4596-927e-3b74d8c48810" status: 200 len: 1755 microversion: 2.1 time: 0.417572 Jun 16 23:10:10.866983 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 542/1070] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:10:10 2022] GET /compute/v2.1/servers/1838efcc-2f09-4596-927e-3b74d8c48810 => generated 1755 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:10:11.884077 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-939427f3-019e-4ec6-ac32-5fd7281e6ac6 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:10:11.884685 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-939427f3-019e-4ec6-ac32-5fd7281e6ac6 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] [instance: 1838efcc-2f09-4596-927e-3b74d8c48810] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:10:11.891166 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-939427f3-019e-4ec6-ac32-5fd7281e6ac6 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:10:11.891613 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-939427f3-019e-4ec6-ac32-5fd7281e6ac6 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:10:11.893123 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-939427f3-019e-4ec6-ac32-5fd7281e6ac6 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:10:11.893123 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-939427f3-019e-4ec6-ac32-5fd7281e6ac6 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:10:12.032185 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-939427f3-019e-4ec6-ac32-5fd7281e6ac6 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d0c2fd023474bb0e4e2df0b14a12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a5ddeaa2ee4af483bd6a59a2900cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:10:12.040128 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-939427f3-019e-4ec6-ac32-5fd7281e6ac6 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] 10.222.0.17 "GET /compute/v2.1/servers/1838efcc-2f09-4596-927e-3b74d8c48810" status: 200 len: 1755 microversion: 2.1 time: 0.159924 Jun 16 23:10:12.040704 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 529/1071] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:10:11 2022] GET /compute/v2.1/servers/1838efcc-2f09-4596-927e-3b74d8c48810 => generated 1755 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:10:13.058176 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-d9d3cc6e-3729-4a04-9eb2-feed7f637791 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:10:13.058830 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-d9d3cc6e-3729-4a04-9eb2-feed7f637791 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] [instance: 1838efcc-2f09-4596-927e-3b74d8c48810] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:10:13.065222 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-d9d3cc6e-3729-4a04-9eb2-feed7f637791 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:10:13.065674 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-d9d3cc6e-3729-4a04-9eb2-feed7f637791 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:10:13.066442 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-d9d3cc6e-3729-4a04-9eb2-feed7f637791 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:10:13.066906 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-d9d3cc6e-3729-4a04-9eb2-feed7f637791 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:10:13.208535 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-d9d3cc6e-3729-4a04-9eb2-feed7f637791 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d0c2fd023474bb0e4e2df0b14a12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a5ddeaa2ee4af483bd6a59a2900cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:10:13.216549 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-d9d3cc6e-3729-4a04-9eb2-feed7f637791 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] 10.222.0.17 "GET /compute/v2.1/servers/1838efcc-2f09-4596-927e-3b74d8c48810" status: 200 len: 1755 microversion: 2.1 time: 0.162250 Jun 16 23:10:13.217114 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 543/1072] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:10:13 2022] GET /compute/v2.1/servers/1838efcc-2f09-4596-927e-3b74d8c48810 => generated 1755 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:10:14.233272 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-36bd4755-a26d-47d3-b3fb-6892490e9956 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:10:14.233901 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-36bd4755-a26d-47d3-b3fb-6892490e9956 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] [instance: 1838efcc-2f09-4596-927e-3b74d8c48810] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:10:14.240324 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-36bd4755-a26d-47d3-b3fb-6892490e9956 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:10:14.240768 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-36bd4755-a26d-47d3-b3fb-6892490e9956 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:10:14.241524 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-36bd4755-a26d-47d3-b3fb-6892490e9956 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:10:14.241955 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-36bd4755-a26d-47d3-b3fb-6892490e9956 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:10:14.390511 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-36bd4755-a26d-47d3-b3fb-6892490e9956 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d0c2fd023474bb0e4e2df0b14a12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a5ddeaa2ee4af483bd6a59a2900cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:10:14.400719 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-36bd4755-a26d-47d3-b3fb-6892490e9956 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] 10.222.0.17 "GET /compute/v2.1/servers/1838efcc-2f09-4596-927e-3b74d8c48810" status: 200 len: 1755 microversion: 2.1 time: 0.171354 Jun 16 23:10:14.401302 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 530/1073] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:10:14 2022] GET /compute/v2.1/servers/1838efcc-2f09-4596-927e-3b74d8c48810 => generated 1755 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:10:15.418237 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-a64fde27-d9da-4f05-8836-0b6ea1d3ff59 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:10:15.418863 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-a64fde27-d9da-4f05-8836-0b6ea1d3ff59 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] [instance: 1838efcc-2f09-4596-927e-3b74d8c48810] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:10:15.425237 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-a64fde27-d9da-4f05-8836-0b6ea1d3ff59 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:10:15.425687 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-a64fde27-d9da-4f05-8836-0b6ea1d3ff59 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:10:15.426442 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-a64fde27-d9da-4f05-8836-0b6ea1d3ff59 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:10:15.426979 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-a64fde27-d9da-4f05-8836-0b6ea1d3ff59 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:10:15.565863 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-a64fde27-d9da-4f05-8836-0b6ea1d3ff59 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d0c2fd023474bb0e4e2df0b14a12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a5ddeaa2ee4af483bd6a59a2900cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:10:15.573835 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-a64fde27-d9da-4f05-8836-0b6ea1d3ff59 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] 10.222.0.17 "GET /compute/v2.1/servers/1838efcc-2f09-4596-927e-3b74d8c48810" status: 200 len: 1755 microversion: 2.1 time: 0.159956 Jun 16 23:10:15.574393 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 544/1074] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:10:15 2022] GET /compute/v2.1/servers/1838efcc-2f09-4596-927e-3b74d8c48810 => generated 1755 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:10:16.591497 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-e4dec9c2-f3e9-49d0-85e4-0ad546971f39 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:10:16.592025 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-e4dec9c2-f3e9-49d0-85e4-0ad546971f39 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] [instance: 1838efcc-2f09-4596-927e-3b74d8c48810] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:10:16.598517 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-e4dec9c2-f3e9-49d0-85e4-0ad546971f39 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:10:16.598997 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-e4dec9c2-f3e9-49d0-85e4-0ad546971f39 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:10:16.599766 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-e4dec9c2-f3e9-49d0-85e4-0ad546971f39 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:10:16.600207 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-e4dec9c2-f3e9-49d0-85e4-0ad546971f39 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:10:16.738415 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-e4dec9c2-f3e9-49d0-85e4-0ad546971f39 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d0c2fd023474bb0e4e2df0b14a12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a5ddeaa2ee4af483bd6a59a2900cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:10:16.746495 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-e4dec9c2-f3e9-49d0-85e4-0ad546971f39 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] 10.222.0.17 "GET /compute/v2.1/servers/1838efcc-2f09-4596-927e-3b74d8c48810" status: 200 len: 1755 microversion: 2.1 time: 0.159482 Jun 16 23:10:16.747087 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 531/1075] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:10:16 2022] GET /compute/v2.1/servers/1838efcc-2f09-4596-927e-3b74d8c48810 => generated 1755 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:10:17.763968 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-337ee9e6-08ce-4648-bbcc-2b66a7232541 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:10:17.764578 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-337ee9e6-08ce-4648-bbcc-2b66a7232541 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] [instance: 1838efcc-2f09-4596-927e-3b74d8c48810] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:10:17.771126 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-337ee9e6-08ce-4648-bbcc-2b66a7232541 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:10:17.771578 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-337ee9e6-08ce-4648-bbcc-2b66a7232541 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:10:17.772338 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-337ee9e6-08ce-4648-bbcc-2b66a7232541 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:10:17.772779 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-337ee9e6-08ce-4648-bbcc-2b66a7232541 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:10:17.912223 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-337ee9e6-08ce-4648-bbcc-2b66a7232541 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d0c2fd023474bb0e4e2df0b14a12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a5ddeaa2ee4af483bd6a59a2900cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:10:17.920092 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-337ee9e6-08ce-4648-bbcc-2b66a7232541 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] 10.222.0.17 "GET /compute/v2.1/servers/1838efcc-2f09-4596-927e-3b74d8c48810" status: 200 len: 1758 microversion: 2.1 time: 0.160656 Jun 16 23:10:17.920651 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 545/1076] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:10:17 2022] GET /compute/v2.1/servers/1838efcc-2f09-4596-927e-3b74d8c48810 => generated 1758 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:10:43.602155 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 23:10:43.603355 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Thu Jun 16 23:10:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 23:10:52.078836 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-b6e42364-82a0-4bf8-8522-b859aff80e87 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-977519909"}} {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 23:10:52.079378 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-b6e42364-82a0-4bf8-8522-b859aff80e87 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] [instance: 1838efcc-2f09-4596-927e-3b74d8c48810] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:10:52.081488 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG dbcounter [-] [117563] Writing DB stats nova_api:SELECT=12 {{(pid=117563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 23:10:52.082168 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG dbcounter [-] [117563] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 23:10:52.088258 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-b6e42364-82a0-4bf8-8522-b859aff80e87 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:10:52.088711 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-b6e42364-82a0-4bf8-8522-b859aff80e87 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:10:52.089487 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-b6e42364-82a0-4bf8-8522-b859aff80e87 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:10:52.089935 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-b6e42364-82a0-4bf8-8522-b859aff80e87 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:10:52.331835 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.network.security_group_api [None req-b6e42364-82a0-4bf8-8522-b859aff80e87 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Removing security group 6e747dff-31c5-44d6-82a9-11ae72ddc37b from port 61b8124a-070e-4798-ac19-c08840a62cf5 Jun 16 23:10:52.662600 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-b6e42364-82a0-4bf8-8522-b859aff80e87 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] 10.222.0.17 "POST /compute/v2.1/servers/1838efcc-2f09-4596-927e-3b74d8c48810/action" status: 202 len: 0 microversion: 2.1 time: 0.587757 Jun 16 23:10:52.663227 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 532/1077] 10.222.0.17 () {60 vars in 1277 bytes} [Thu Jun 16 23:10:52 2022] POST /compute/v2.1/servers/1838efcc-2f09-4596-927e-3b74d8c48810/action => generated 0 bytes in 589 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 23:10:52.674426 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [req-4471ae24-1c5f-41fa-9e4a-fabc6cfed3c8 req-90320aa9-2f46-4ad6-b67c-5035e1fcf46e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1838efcc-2f09-4596-927e-3b74d8c48810", "tag": "61b8124a-070e-4798-ac19-c08840a62cf5"}]} {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 23:10:52.693571 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG dbcounter [-] [117562] Writing DB stats nova_api:SELECT=12 {{(pid=117562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 23:10:52.697797 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG dbcounter [-] [117562] Writing DB stats nova_cell1:SELECT=36 {{(pid=117562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 23:10:52.700809 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [req-4471ae24-1c5f-41fa-9e4a-fabc6cfed3c8 req-90320aa9-2f46-4ad6-b67c-5035e1fcf46e service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:10:52.701882 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [req-4471ae24-1c5f-41fa-9e4a-fabc6cfed3c8 req-90320aa9-2f46-4ad6-b67c-5035e1fcf46e service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:10:52.720061 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.compute.server_external_events [req-4471ae24-1c5f-41fa-9e4a-fabc6cfed3c8 req-90320aa9-2f46-4ad6-b67c-5035e1fcf46e service nova] Creating event network-changed:61b8124a-070e-4798-ac19-c08840a62cf5 for instance 1838efcc-2f09-4596-927e-3b74d8c48810 on hv-cinder-84623 Jun 16 23:10:52.737569 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [req-4471ae24-1c5f-41fa-9e4a-fabc6cfed3c8 req-90320aa9-2f46-4ad6-b67c-5035e1fcf46e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067080 Jun 16 23:10:52.738241 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 546/1078] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 23:10:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 23:10:53.845652 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-3d340c3f-af5b-4f09-9156-a923f0548de4 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:10:53.846159 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-3d340c3f-af5b-4f09-9156-a923f0548de4 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] [instance: 1838efcc-2f09-4596-927e-3b74d8c48810] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:10:53.852678 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-3d340c3f-af5b-4f09-9156-a923f0548de4 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:10:53.853134 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-3d340c3f-af5b-4f09-9156-a923f0548de4 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:10:53.853908 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-3d340c3f-af5b-4f09-9156-a923f0548de4 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:10:53.854348 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-3d340c3f-af5b-4f09-9156-a923f0548de4 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:10:53.935914 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.objects.instance [None req-3d340c3f-af5b-4f09-9156-a923f0548de4 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Lazy-loading 'services' on Instance uuid 1838efcc-2f09-4596-927e-3b74d8c48810 {{(pid=117563) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 23:10:54.009114 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-3d340c3f-af5b-4f09-9156-a923f0548de4 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] 10.222.0.17 "DELETE /compute/v2.1/servers/1838efcc-2f09-4596-927e-3b74d8c48810/os-volume_attachments/6e6b0291-e962-452f-a785-f3886cf466b1" status: 202 len: 0 microversion: 2.1 time: 0.167951 Jun 16 23:10:54.009802 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 533/1079] 10.222.0.17 () {58 vars in 1415 bytes} [Thu Jun 16 23:10:53 2022] DELETE /compute/v2.1/servers/1838efcc-2f09-4596-927e-3b74d8c48810/os-volume_attachments/6e6b0291-e962-452f-a785-f3886cf466b1 => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 23:10:54.019388 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-87b5508d-87c0-4435-a0d6-a8638b7cfc24 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:10:54.020562 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-87b5508d-87c0-4435-a0d6-a8638b7cfc24 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] [instance: 1838efcc-2f09-4596-927e-3b74d8c48810] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:10:54.027636 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-87b5508d-87c0-4435-a0d6-a8638b7cfc24 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:10:54.028073 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-87b5508d-87c0-4435-a0d6-a8638b7cfc24 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:10:54.028853 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-87b5508d-87c0-4435-a0d6-a8638b7cfc24 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:10:54.029333 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-87b5508d-87c0-4435-a0d6-a8638b7cfc24 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:10:54.059647 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-87b5508d-87c0-4435-a0d6-a8638b7cfc24 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] 10.222.0.17 "GET /compute/v2.1/servers/1838efcc-2f09-4596-927e-3b74d8c48810/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045291 Jun 16 23:10:54.060551 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 547/1080] 10.222.0.17 () {58 vars in 1301 bytes} [Thu Jun 16 23:10:54 2022] GET /compute/v2.1/servers/1838efcc-2f09-4596-927e-3b74d8c48810/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 23:10:54.753158 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [req-03e3398c-f89b-458f-b194-cb2d52df7ff4 req-2ec450f5-ead5-4e60-bafc-7919590e1af5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1838efcc-2f09-4596-927e-3b74d8c48810", "tag": "61b8124a-070e-4798-ac19-c08840a62cf5"}]} {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 23:10:54.761489 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-03e3398c-f89b-458f-b194-cb2d52df7ff4 req-2ec450f5-ead5-4e60-bafc-7919590e1af5 service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:10:54.761934 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-03e3398c-f89b-458f-b194-cb2d52df7ff4 req-2ec450f5-ead5-4e60-bafc-7919590e1af5 service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:10:54.775217 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.compute.server_external_events [req-03e3398c-f89b-458f-b194-cb2d52df7ff4 req-2ec450f5-ead5-4e60-bafc-7919590e1af5 service nova] Creating event network-changed:61b8124a-070e-4798-ac19-c08840a62cf5 for instance 1838efcc-2f09-4596-927e-3b74d8c48810 on hv-cinder-84623 Jun 16 23:10:54.781060 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [req-03e3398c-f89b-458f-b194-cb2d52df7ff4 req-2ec450f5-ead5-4e60-bafc-7919590e1af5 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031790 Jun 16 23:10:54.781659 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 534/1081] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 23:10:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 23:10:55.071806 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-2390778f-35d9-4ba9-a950-6dc02f3d6f24 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:10:55.072885 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-2390778f-35d9-4ba9-a950-6dc02f3d6f24 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] [instance: 1838efcc-2f09-4596-927e-3b74d8c48810] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:10:55.079137 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-2390778f-35d9-4ba9-a950-6dc02f3d6f24 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:10:55.079585 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-2390778f-35d9-4ba9-a950-6dc02f3d6f24 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:10:55.080345 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-2390778f-35d9-4ba9-a950-6dc02f3d6f24 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:10:55.080775 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-2390778f-35d9-4ba9-a950-6dc02f3d6f24 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:10:55.110893 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-2390778f-35d9-4ba9-a950-6dc02f3d6f24 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] 10.222.0.17 "GET /compute/v2.1/servers/1838efcc-2f09-4596-927e-3b74d8c48810/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043198 Jun 16 23:10:55.111575 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 548/1082] 10.222.0.17 () {58 vars in 1301 bytes} [Thu Jun 16 23:10:55 2022] GET /compute/v2.1/servers/1838efcc-2f09-4596-927e-3b74d8c48810/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 23:10:56.123673 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-5a5ee5eb-b299-4eb5-a17b-99b0dadf5ba5 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:10:56.124661 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-5a5ee5eb-b299-4eb5-a17b-99b0dadf5ba5 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] [instance: 1838efcc-2f09-4596-927e-3b74d8c48810] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:10:56.130890 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-5a5ee5eb-b299-4eb5-a17b-99b0dadf5ba5 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:10:56.131333 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-5a5ee5eb-b299-4eb5-a17b-99b0dadf5ba5 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:10:56.132083 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-5a5ee5eb-b299-4eb5-a17b-99b0dadf5ba5 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:10:56.132514 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-5a5ee5eb-b299-4eb5-a17b-99b0dadf5ba5 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:10:56.159703 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-5a5ee5eb-b299-4eb5-a17b-99b0dadf5ba5 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] 10.222.0.17 "GET /compute/v2.1/servers/1838efcc-2f09-4596-927e-3b74d8c48810/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.040850 Jun 16 23:10:56.160249 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 535/1083] 10.222.0.17 () {58 vars in 1301 bytes} [Thu Jun 16 23:10:56 2022] GET /compute/v2.1/servers/1838efcc-2f09-4596-927e-3b74d8c48810/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 23:10:56.170897 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-863c9f92-4c7c-432f-9ceb-0150a312ece6 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:10:56.171524 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-863c9f92-4c7c-432f-9ceb-0150a312ece6 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] [instance: 1838efcc-2f09-4596-927e-3b74d8c48810] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:10:56.177836 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-863c9f92-4c7c-432f-9ceb-0150a312ece6 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:10:56.178288 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-863c9f92-4c7c-432f-9ceb-0150a312ece6 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:10:56.179747 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-863c9f92-4c7c-432f-9ceb-0150a312ece6 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:10:56.180189 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-863c9f92-4c7c-432f-9ceb-0150a312ece6 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:10:56.349664 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.wsgi [None req-863c9f92-4c7c-432f-9ceb-0150a312ece6 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] HTTP exception thrown: Instance 1838efcc-2f09-4596-927e-3b74d8c48810 is not attached to volume 6e6b0291-e962-452f-a785-f3886cf466b1 Jun 16 23:10:56.352624 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-863c9f92-4c7c-432f-9ceb-0150a312ece6 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Request method failure captured: Jun 16 23:10:56.352624 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: request: DELETE /compute/v2.1/servers/1838efcc-2f09-4596-927e-3b74d8c48810/os-volume_attachments/6e6b0291-e962-452f-a785-f3886cf466b1 HTTP/1.1 Jun 16 23:10:56.352624 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Accept: application/json Jun 16 23:10:56.352624 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Accept-Encoding: identity Jun 16 23:10:56.352624 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Connection: close Jun 16 23:10:56.352624 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Content-Length: 0 Jun 16 23:10:56.352624 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Content-Type: application/json Jun 16 23:10:56.352624 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Host: 10.222.0.17 Jun 16 23:10:56.352624 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Openstack-System-Scope: None Jun 16 23:10:56.352624 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: User-Agent: python-urllib3/1.26.9 Jun 16 23:10:56.352624 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Auth-Token: gAAAAABiq7gKh6chOoriosJlp3Kn-o-XgK4xqPWypguV8tuL3OUWDfUe2HBSt6vpo5LX7aYduCfiCbVbjU1bf8IrVb4iHcYvkdUQfxTnUYn5U8G1FrM605xFGvJAlDd7g8Qd1-8pE9_NzbtXpwzm2rkxhK2VJRu5fODeMfK6folflZMTeWxzpLM Jun 16 23:10:56.352624 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Domain-Id: None Jun 16 23:10:56.352624 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Domain-Name: None Jun 16 23:10:56.352624 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Identity-Status: Confirmed Jun 16 23:10:56.352624 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Is-Admin-Project: True Jun 16 23:10:56.352624 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Project-Domain-Id: default Jun 16 23:10:56.352624 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Project-Domain-Name: Default Jun 16 23:10:56.352624 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Project-Id: 09a5ddeaa2ee4af483bd6a59a2900cf7 Jun 16 23:10:56.352624 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Project-Name: tempest-TestMinimumBasicScenario-527706054 Jun 16 23:10:56.352624 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Role: member,reader Jun 16 23:10:56.352624 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Roles: member,reader Jun 16 23:10:56.354408 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/09a5ddeaa2ee4af483bd6a59a2900cf7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_09a5ddeaa2ee4af483bd6a59a2900cf7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/09a5ddeaa2ee4af483bd6a59a2900cf7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/09a5ddeaa2ee4af483bd6a59a2900cf7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Jun 16 23:10:56.354408 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Tenant: tempest-TestMinimumBasicScenario-527706054 Jun 16 23:10:56.354408 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Tenant-Id: 09a5ddeaa2ee4af483bd6a59a2900cf7 Jun 16 23:10:56.354408 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Tenant-Name: tempest-TestMinimumBasicScenario-527706054 Jun 16 23:10:56.354408 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-User: tempest-TestMinimumBasicScenario-527706054-project Jun 16 23:10:56.354408 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-User-Domain-Id: default Jun 16 23:10:56.354408 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-User-Domain-Name: Default Jun 16 23:10:56.354408 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-User-Id: 4e3d0c2fd023474bb0e4e2df0b14a12c Jun 16 23:10:56.354408 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-User-Name: tempest-TestMinimumBasicScenario-527706054-project Jun 16 23:10:56.354408 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: method: > Jun 16 23:10:56.354408 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: exception: Instance 1838efcc-2f09-4596-927e-3b74d8c48810 is not attached to volume 6e6b0291-e962-452f-a785-f3886cf466b1 Jun 16 23:10:56.355496 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: action_args: {'server_id': '1838efcc-2f09-4596-927e-3b74d8c48810', 'id': '6e6b0291-e962-452f-a785-f3886cf466b1'} Jun 16 23:10:56.355496 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 23:10:56.355496 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 23:10:56.355496 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jun 16 23:10:56.355496 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jun 16 23:10:56.355496 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 23:10:56.355496 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 23:10:56.355496 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jun 16 23:10:56.355496 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jun 16 23:10:56.355496 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 6e6b0291-e962-452f-a785-f3886cf466b1. Jun 16 23:10:56.355496 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Jun 16 23:10:56.355496 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 23:10:56.355496 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Jun 16 23:10:56.355496 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 23:10:56.355496 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 23:10:56.355496 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 23:10:56.355496 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 23:10:56.355496 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 23:10:56.355496 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 23:10:56.357026 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 23:10:56.357026 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jun 16 23:10:56.357026 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 16 23:10:56.357026 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1838efcc-2f09-4596-927e-3b74d8c48810 is not attached to volume 6e6b0291-e962-452f-a785-f3886cf466b1 Jun 16 23:10:56.357026 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Jun 16 23:10:56.357026 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 23:10:56.357026 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Jun 16 23:10:56.357026 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 23:10:56.357026 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 23:10:56.357026 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 23:10:56.357026 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 23:10:56.357026 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 23:10:56.357026 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1838efcc-2f09-4596-927e-3b74d8c48810 is not attached to volume 6e6b0291-e962-452f-a785-f3886cf466b1 Jun 16 23:10:56.357026 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Jun 16 23:10:56.357026 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-863c9f92-4c7c-432f-9ceb-0150a312ece6 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Returning 404 to user: Instance 1838efcc-2f09-4596-927e-3b74d8c48810 is not attached to volume 6e6b0291-e962-452f-a785-f3886cf466b1 {{(pid=117562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 23:10:56.358376 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-863c9f92-4c7c-432f-9ceb-0150a312ece6 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] 10.222.0.17 "DELETE /compute/v2.1/servers/1838efcc-2f09-4596-927e-3b74d8c48810/os-volume_attachments/6e6b0291-e962-452f-a785-f3886cf466b1" status: 404 len: 154 microversion: 2.1 time: 0.187129 Jun 16 23:10:56.358376 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 549/1084] 10.222.0.17 () {58 vars in 1415 bytes} [Thu Jun 16 23:10:56 2022] DELETE /compute/v2.1/servers/1838efcc-2f09-4596-927e-3b74d8c48810/os-volume_attachments/6e6b0291-e962-452f-a785-f3886cf466b1 => generated 154 bytes in 188 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 23:10:56.852926 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-b8a3fece-a523-419c-8f5e-2d2eaf5b3ce1 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-527390493", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1351668635", "security_groups": [{"name": "tempest-secgroup-smoke-307129787"}], "block_device_mapping_v2": [{"uuid": "94ae5e78-2e5c-4e53-93a3-cab9e4cb3475", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "b60aa0be-29dc-41f5-b1f9-8245b5200d1c"}]}} {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 23:10:56.960935 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.network.neutron [None req-b8a3fece-a523-419c-8f5e-2d2eaf5b3ce1 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] validate_networks() for [('b60aa0be-29dc-41f5-b1f9-8245b5200d1c', None, None, None, None, None)] {{(pid=117563) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 23:10:57.319008 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.virt.hardware [None req-b8a3fece-a523-419c-8f5e-2d2eaf5b3ce1 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Flavor limits 0:0:0 {{(pid=117563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 23:10:57.320162 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.virt.hardware [None req-b8a3fece-a523-419c-8f5e-2d2eaf5b3ce1 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Image limits 0:0:0 {{(pid=117563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 23:10:57.320503 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.virt.hardware [None req-b8a3fece-a523-419c-8f5e-2d2eaf5b3ce1 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Flavor pref 0:0:0 {{(pid=117563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 23:10:57.320911 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.virt.hardware [None req-b8a3fece-a523-419c-8f5e-2d2eaf5b3ce1 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Image pref 0:0:0 {{(pid=117563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 23:10:57.321319 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.virt.hardware [None req-b8a3fece-a523-419c-8f5e-2d2eaf5b3ce1 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117563) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 23:10:57.330027 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-b8a3fece-a523-419c-8f5e-2d2eaf5b3ce1 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:10:57.330485 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-b8a3fece-a523-419c-8f5e-2d2eaf5b3ce1 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:10:57.331314 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-b8a3fece-a523-419c-8f5e-2d2eaf5b3ce1 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:10:57.331752 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-b8a3fece-a523-419c-8f5e-2d2eaf5b3ce1 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:10:57.348436 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.quota [None req-b8a3fece-a523-419c-8f5e-2d2eaf5b3ce1 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Getting quotas for project 1423c05c42b14519b401e22e16062781. Resources: {'instances', 'cores', 'ram'} {{(pid=117563) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 23:10:57.352347 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.quota [None req-b8a3fece-a523-419c-8f5e-2d2eaf5b3ce1 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Getting quotas for user 2697aa77265e4f5783f87ffb3d4992b5 and project 1423c05c42b14519b401e22e16062781. Resources: {'instances', 'cores', 'ram'} {{(pid=117563) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 23:10:57.407032 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-b8a3fece-a523-419c-8f5e-2d2eaf5b3ce1 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Going to run 1 instances... {{(pid=117563) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 23:10:57.409091 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-b8a3fece-a523-419c-8f5e-2d2eaf5b3ce1 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] [instance: b5682421-8a91-43a1-88fb-8d2a158ad6d7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='94ae5e78-2e5c-4e53-93a3-cab9e4cb3475',volume_size=None,volume_type=None)] {{(pid=117563) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 23:10:57.488557 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-c337f281-0a00-4b50-9f03-803c7627cdf3 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:10:57.489067 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-c337f281-0a00-4b50-9f03-803c7627cdf3 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] [instance: 1838efcc-2f09-4596-927e-3b74d8c48810] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:10:57.496553 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-c337f281-0a00-4b50-9f03-803c7627cdf3 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:10:57.497015 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-c337f281-0a00-4b50-9f03-803c7627cdf3 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:10:57.497797 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-c337f281-0a00-4b50-9f03-803c7627cdf3 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:10:57.498243 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-c337f281-0a00-4b50-9f03-803c7627cdf3 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:10:57.524900 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-c337f281-0a00-4b50-9f03-803c7627cdf3 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] [instance: 1838efcc-2f09-4596-927e-3b74d8c48810] Going to try to terminate instance {{(pid=117562) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 23:10:57.540890 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-b8a3fece-a523-419c-8f5e-2d2eaf5b3ce1 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.691736 Jun 16 23:10:57.541532 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 536/1085] 10.222.0.17 () {60 vars in 1146 bytes} [Thu Jun 16 23:10:56 2022] POST /compute/v2.1/servers => generated 405 bytes in 693 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 23:10:57.551456 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-25efa3d6-bad6-4e1d-b51b-6727413e9d81 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:10:57.552052 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-25efa3d6-bad6-4e1d-b51b-6727413e9d81 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] [instance: b5682421-8a91-43a1-88fb-8d2a158ad6d7] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:10:57.618067 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-c337f281-0a00-4b50-9f03-803c7627cdf3 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] 10.222.0.17 "DELETE /compute/v2.1/servers/1838efcc-2f09-4596-927e-3b74d8c48810" status: 204 len: 0 microversion: 2.1 time: 0.133053 Jun 16 23:10:57.621977 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-25efa3d6-bad6-4e1d-b51b-6727413e9d81 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2697aa77265e4f5783f87ffb3d4992b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1423c05c42b14519b401e22e16062781', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:10:57.622974 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 550/1086] 10.222.0.17 () {58 vars in 1238 bytes} [Thu Jun 16 23:10:57 2022] DELETE /compute/v2.1/servers/1838efcc-2f09-4596-927e-3b74d8c48810 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 23:10:57.631105 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-25efa3d6-bad6-4e1d-b51b-6727413e9d81 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] 10.222.0.17 "GET /compute/v2.1/servers/b5682421-8a91-43a1-88fb-8d2a158ad6d7" status: 200 len: 1094 microversion: 2.1 time: 0.083006 Jun 16 23:10:57.631303 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-47361028-120b-427c-80f5-cf812dcba39f tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:10:57.632386 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 537/1087] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:10:57 2022] GET /compute/v2.1/servers/b5682421-8a91-43a1-88fb-8d2a158ad6d7 => generated 1094 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 23:10:57.634994 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-47361028-120b-427c-80f5-cf812dcba39f tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] [instance: 1838efcc-2f09-4596-927e-3b74d8c48810] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:10:57.641807 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-47361028-120b-427c-80f5-cf812dcba39f tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:10:57.642351 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-47361028-120b-427c-80f5-cf812dcba39f tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:10:57.643197 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-47361028-120b-427c-80f5-cf812dcba39f tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:10:57.643651 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-47361028-120b-427c-80f5-cf812dcba39f tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:10:57.777214 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-47361028-120b-427c-80f5-cf812dcba39f tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d0c2fd023474bb0e4e2df0b14a12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a5ddeaa2ee4af483bd6a59a2900cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:10:57.784816 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-47361028-120b-427c-80f5-cf812dcba39f tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] 10.222.0.17 "GET /compute/v2.1/servers/1838efcc-2f09-4596-927e-3b74d8c48810" status: 200 len: 1553 microversion: 2.1 time: 0.157520 Jun 16 23:10:57.785245 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 551/1088] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:10:57 2022] GET /compute/v2.1/servers/1838efcc-2f09-4596-927e-3b74d8c48810 => generated 1553 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 23:10:58.702060 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-c1163c28-18ce-4881-a83d-bf75c8a74567 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:10:58.702690 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-c1163c28-18ce-4881-a83d-bf75c8a74567 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] [instance: b5682421-8a91-43a1-88fb-8d2a158ad6d7] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:10:58.709011 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-c1163c28-18ce-4881-a83d-bf75c8a74567 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:10:58.709451 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-c1163c28-18ce-4881-a83d-bf75c8a74567 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:10:58.710206 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-c1163c28-18ce-4881-a83d-bf75c8a74567 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:10:58.710672 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-c1163c28-18ce-4881-a83d-bf75c8a74567 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:10:58.769216 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-c1163c28-18ce-4881-a83d-bf75c8a74567 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2697aa77265e4f5783f87ffb3d4992b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1423c05c42b14519b401e22e16062781', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:10:58.780933 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-c1163c28-18ce-4881-a83d-bf75c8a74567 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] 10.222.0.17 "GET /compute/v2.1/servers/b5682421-8a91-43a1-88fb-8d2a158ad6d7" status: 200 len: 1144 microversion: 2.1 time: 0.137192 Jun 16 23:10:58.781504 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 538/1089] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:10:58 2022] GET /compute/v2.1/servers/b5682421-8a91-43a1-88fb-8d2a158ad6d7 => generated 1144 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:10:58.802305 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-2ec4fa53-e6d3-4f53-a988-6f7f00f702fc tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:10:58.802970 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-2ec4fa53-e6d3-4f53-a988-6f7f00f702fc tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] [instance: 1838efcc-2f09-4596-927e-3b74d8c48810] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:10:58.810180 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-2ec4fa53-e6d3-4f53-a988-6f7f00f702fc tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:10:58.810660 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-2ec4fa53-e6d3-4f53-a988-6f7f00f702fc tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:10:58.811514 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-2ec4fa53-e6d3-4f53-a988-6f7f00f702fc tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:10:58.811956 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-2ec4fa53-e6d3-4f53-a988-6f7f00f702fc tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:10:58.940324 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-2ec4fa53-e6d3-4f53-a988-6f7f00f702fc tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d0c2fd023474bb0e4e2df0b14a12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a5ddeaa2ee4af483bd6a59a2900cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:10:58.948072 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-2ec4fa53-e6d3-4f53-a988-6f7f00f702fc tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] 10.222.0.17 "GET /compute/v2.1/servers/1838efcc-2f09-4596-927e-3b74d8c48810" status: 200 len: 1553 microversion: 2.1 time: 0.149577 Jun 16 23:10:58.948628 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 552/1090] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:10:58 2022] GET /compute/v2.1/servers/1838efcc-2f09-4596-927e-3b74d8c48810 => generated 1553 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:10:59.798854 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-b89bd2ab-0c66-446c-a043-c9befcd61244 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:10:59.799448 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-b89bd2ab-0c66-446c-a043-c9befcd61244 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] [instance: b5682421-8a91-43a1-88fb-8d2a158ad6d7] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:10:59.807194 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-b89bd2ab-0c66-446c-a043-c9befcd61244 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:10:59.807944 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-b89bd2ab-0c66-446c-a043-c9befcd61244 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:10:59.808751 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-b89bd2ab-0c66-446c-a043-c9befcd61244 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:10:59.809440 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-b89bd2ab-0c66-446c-a043-c9befcd61244 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:10:59.881870 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-b89bd2ab-0c66-446c-a043-c9befcd61244 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2697aa77265e4f5783f87ffb3d4992b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1423c05c42b14519b401e22e16062781', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:10:59.891008 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-b89bd2ab-0c66-446c-a043-c9befcd61244 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] 10.222.0.17 "GET /compute/v2.1/servers/b5682421-8a91-43a1-88fb-8d2a158ad6d7" status: 200 len: 1210 microversion: 2.1 time: 0.095869 Jun 16 23:10:59.891784 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 539/1091] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:10:59 2022] GET /compute/v2.1/servers/b5682421-8a91-43a1-88fb-8d2a158ad6d7 => generated 1210 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:10:59.966406 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-0e94e9a7-a66a-4f86-964c-96199fef37be tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:10:59.967200 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-0e94e9a7-a66a-4f86-964c-96199fef37be tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] [instance: 1838efcc-2f09-4596-927e-3b74d8c48810] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:10:59.977748 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-0e94e9a7-a66a-4f86-964c-96199fef37be tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:10:59.978579 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-0e94e9a7-a66a-4f86-964c-96199fef37be tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:10:59.979905 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-0e94e9a7-a66a-4f86-964c-96199fef37be tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:10:59.980407 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-0e94e9a7-a66a-4f86-964c-96199fef37be tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:11:00.010216 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [req-83d57fb1-3fb2-495a-a560-2b93db4d6397 req-91d343d9-47f3-4d97-a593-38cf96202f05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1838efcc-2f09-4596-927e-3b74d8c48810", "name": "network-vif-deleted", "tag": "61b8124a-070e-4798-ac19-c08840a62cf5"}]} {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 23:11:00.020258 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-83d57fb1-3fb2-495a-a560-2b93db4d6397 req-91d343d9-47f3-4d97-a593-38cf96202f05 service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:11:00.020610 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-83d57fb1-3fb2-495a-a560-2b93db4d6397 req-91d343d9-47f3-4d97-a593-38cf96202f05 service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:11:00.033450 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.compute.server_external_events [req-83d57fb1-3fb2-495a-a560-2b93db4d6397 req-91d343d9-47f3-4d97-a593-38cf96202f05 service nova] Creating event network-vif-deleted:61b8124a-070e-4798-ac19-c08840a62cf5 for instance 1838efcc-2f09-4596-927e-3b74d8c48810 on hv-cinder-84623 Jun 16 23:11:00.039154 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [req-83d57fb1-3fb2-495a-a560-2b93db4d6397 req-91d343d9-47f3-4d97-a593-38cf96202f05 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033743 Jun 16 23:11:00.040043 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 540/1092] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 23:11:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 23:11:00.070258 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-0e94e9a7-a66a-4f86-964c-96199fef37be tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3d0c2fd023474bb0e4e2df0b14a12c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a5ddeaa2ee4af483bd6a59a2900cf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:11:00.080852 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-0e94e9a7-a66a-4f86-964c-96199fef37be tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] 10.222.0.17 "GET /compute/v2.1/servers/1838efcc-2f09-4596-927e-3b74d8c48810" status: 200 len: 1511 microversion: 2.1 time: 0.119142 Jun 16 23:11:00.081684 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 553/1093] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:10:59 2022] GET /compute/v2.1/servers/1838efcc-2f09-4596-927e-3b74d8c48810 => generated 1511 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:11:00.909668 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-06c6131f-7618-4dc3-b1c7-cd90737cdbd0 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:11:00.911501 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-06c6131f-7618-4dc3-b1c7-cd90737cdbd0 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] [instance: b5682421-8a91-43a1-88fb-8d2a158ad6d7] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:11:00.919893 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-06c6131f-7618-4dc3-b1c7-cd90737cdbd0 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:11:00.920350 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-06c6131f-7618-4dc3-b1c7-cd90737cdbd0 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:11:00.921230 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-06c6131f-7618-4dc3-b1c7-cd90737cdbd0 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:11:00.921668 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-06c6131f-7618-4dc3-b1c7-cd90737cdbd0 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:11:01.100002 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-383fc615-c2a5-42cf-96b9-621d98f06a50 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:11:01.100705 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-383fc615-c2a5-42cf-96b9-621d98f06a50 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] [instance: 1838efcc-2f09-4596-927e-3b74d8c48810] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:11:01.108471 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-383fc615-c2a5-42cf-96b9-621d98f06a50 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:11:01.108961 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-383fc615-c2a5-42cf-96b9-621d98f06a50 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:11:01.109744 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-383fc615-c2a5-42cf-96b9-621d98f06a50 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:11:01.110187 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-383fc615-c2a5-42cf-96b9-621d98f06a50 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:11:01.119561 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-06c6131f-7618-4dc3-b1c7-cd90737cdbd0 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2697aa77265e4f5783f87ffb3d4992b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1423c05c42b14519b401e22e16062781', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:11:01.124600 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.wsgi [None req-383fc615-c2a5-42cf-96b9-621d98f06a50 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] HTTP exception thrown: Instance 1838efcc-2f09-4596-927e-3b74d8c48810 could not be found. Jun 16 23:11:01.126293 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-383fc615-c2a5-42cf-96b9-621d98f06a50 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Request method failure captured: Jun 16 23:11:01.126293 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: request: GET /compute/v2.1/servers/1838efcc-2f09-4596-927e-3b74d8c48810 HTTP/1.1 Jun 16 23:11:01.126293 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Accept: application/json Jun 16 23:11:01.126293 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Accept-Encoding: identity Jun 16 23:11:01.126293 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Connection: close Jun 16 23:11:01.126293 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Content-Length: 0 Jun 16 23:11:01.126293 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Content-Type: application/json Jun 16 23:11:01.126293 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Host: 10.222.0.17 Jun 16 23:11:01.126293 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Openstack-System-Scope: None Jun 16 23:11:01.126293 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: User-Agent: python-urllib3/1.26.9 Jun 16 23:11:01.126293 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Auth-Token: gAAAAABiq7gKh6chOoriosJlp3Kn-o-XgK4xqPWypguV8tuL3OUWDfUe2HBSt6vpo5LX7aYduCfiCbVbjU1bf8IrVb4iHcYvkdUQfxTnUYn5U8G1FrM605xFGvJAlDd7g8Qd1-8pE9_NzbtXpwzm2rkxhK2VJRu5fODeMfK6folflZMTeWxzpLM Jun 16 23:11:01.126293 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Domain-Id: None Jun 16 23:11:01.126293 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Domain-Name: None Jun 16 23:11:01.126293 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Identity-Status: Confirmed Jun 16 23:11:01.126293 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Is-Admin-Project: True Jun 16 23:11:01.126293 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Project-Domain-Id: default Jun 16 23:11:01.126293 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Project-Domain-Name: Default Jun 16 23:11:01.126293 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Project-Id: 09a5ddeaa2ee4af483bd6a59a2900cf7 Jun 16 23:11:01.126293 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Project-Name: tempest-TestMinimumBasicScenario-527706054 Jun 16 23:11:01.126293 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Role: member,reader Jun 16 23:11:01.126293 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Roles: member,reader Jun 16 23:11:01.127772 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/09a5ddeaa2ee4af483bd6a59a2900cf7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_09a5ddeaa2ee4af483bd6a59a2900cf7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/09a5ddeaa2ee4af483bd6a59a2900cf7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/09a5ddeaa2ee4af483bd6a59a2900cf7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Jun 16 23:11:01.127772 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Tenant: tempest-TestMinimumBasicScenario-527706054 Jun 16 23:11:01.127772 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Tenant-Id: 09a5ddeaa2ee4af483bd6a59a2900cf7 Jun 16 23:11:01.127772 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Tenant-Name: tempest-TestMinimumBasicScenario-527706054 Jun 16 23:11:01.127772 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-User: tempest-TestMinimumBasicScenario-527706054-project Jun 16 23:11:01.127772 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-User-Domain-Id: default Jun 16 23:11:01.127772 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-User-Domain-Name: Default Jun 16 23:11:01.127772 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-User-Id: 4e3d0c2fd023474bb0e4e2df0b14a12c Jun 16 23:11:01.127772 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-User-Name: tempest-TestMinimumBasicScenario-527706054-project Jun 16 23:11:01.127772 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: method: > Jun 16 23:11:01.127772 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: exception: Instance 1838efcc-2f09-4596-927e-3b74d8c48810 could not be found. Jun 16 23:11:01.127772 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: action_args: {'id': '1838efcc-2f09-4596-927e-3b74d8c48810'} Jun 16 23:11:01.128559 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 23:11:01.128559 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 23:11:01.128559 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 23:11:01.128559 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 23:11:01.128559 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 23:11:01.128559 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 23:11:01.128559 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 23:11:01.128559 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 23:11:01.128559 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 23:11:01.128559 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 23:11:01.128559 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1838efcc-2f09-4596-927e-3b74d8c48810 could not be found. Jun 16 23:11:01.128559 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Jun 16 23:11:01.128559 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 23:11:01.128559 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Jun 16 23:11:01.128559 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 23:11:01.128559 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 23:11:01.128559 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 23:11:01.128559 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 23:11:01.128559 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 23:11:01.128559 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 23:11:01.129943 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 23:11:01.129943 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 23:11:01.129943 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 23:11:01.129943 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 23:11:01.129943 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 23:11:01.129943 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 23:11:01.129943 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 23:11:01.129943 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1838efcc-2f09-4596-927e-3b74d8c48810 could not be found. Jun 16 23:11:01.129943 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Jun 16 23:11:01.129943 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 23:11:01.129943 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Jun 16 23:11:01.129943 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 23:11:01.129943 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 23:11:01.129943 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 23:11:01.129943 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 23:11:01.129943 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 23:11:01.129943 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1838efcc-2f09-4596-927e-3b74d8c48810 could not be found. Jun 16 23:11:01.129943 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Jun 16 23:11:01.131170 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-383fc615-c2a5-42cf-96b9-621d98f06a50 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Returning 404 to user: Instance 1838efcc-2f09-4596-927e-3b74d8c48810 could not be found. {{(pid=117562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 23:11:01.131250 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-06c6131f-7618-4dc3-b1c7-cd90737cdbd0 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] 10.222.0.17 "GET /compute/v2.1/servers/b5682421-8a91-43a1-88fb-8d2a158ad6d7" status: 200 len: 1265 microversion: 2.1 time: 0.223219 Jun 16 23:11:01.131347 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-383fc615-c2a5-42cf-96b9-621d98f06a50 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] 10.222.0.17 "GET /compute/v2.1/servers/1838efcc-2f09-4596-927e-3b74d8c48810" status: 404 len: 111 microversion: 2.1 time: 0.032514 Jun 16 23:11:01.131347 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 554/1094] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:11:01 2022] GET /compute/v2.1/servers/1838efcc-2f09-4596-927e-3b74d8c48810 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 23:11:01.139774 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 541/1095] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:11:00 2022] GET /compute/v2.1/servers/b5682421-8a91-43a1-88fb-8d2a158ad6d7 => generated 1265 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:11:01.144947 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-a45f3c0c-54e8-4319-ab56-8120aad18012 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] Calling method '.version_select at 0x7f5313f9c700>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:11:01.160608 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [req-bf532222-2425-45f2-8d96-fe34d2036587 req-091c86c2-a4c1-480a-a5eb-4cbc1dc695ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5682421-8a91-43a1-88fb-8d2a158ad6d7", "tag": "a1370d08-1392-4cb6-ba52-ee441d4147b5"}]} {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 23:11:01.178025 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-a45f3c0c-54e8-4319-ab56-8120aad18012 tempest-TestMinimumBasicScenario-527706054 tempest-TestMinimumBasicScenario-527706054-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-653878578" status: 202 len: 0 microversion: 2.1 time: 0.036885 Jun 16 23:11:01.178680 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 555/1096] 10.222.0.17 () {58 vars in 1268 bytes} [Thu Jun 16 23:11:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-653878578 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 23:11:01.181011 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-bf532222-2425-45f2-8d96-fe34d2036587 req-091c86c2-a4c1-480a-a5eb-4cbc1dc695ab service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:11:01.181829 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-bf532222-2425-45f2-8d96-fe34d2036587 req-091c86c2-a4c1-480a-a5eb-4cbc1dc695ab service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:11:01.198826 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.compute.server_external_events [req-bf532222-2425-45f2-8d96-fe34d2036587 req-091c86c2-a4c1-480a-a5eb-4cbc1dc695ab service nova] Creating event network-changed:a1370d08-1392-4cb6-ba52-ee441d4147b5 for instance b5682421-8a91-43a1-88fb-8d2a158ad6d7 on hv-cinder-84623 Jun 16 23:11:01.213020 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [req-bf532222-2425-45f2-8d96-fe34d2036587 req-091c86c2-a4c1-480a-a5eb-4cbc1dc695ab service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047509 Jun 16 23:11:01.214037 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 542/1097] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 23:11:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 23:11:02.145506 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-0707dfae-c9f2-4989-ba3b-dae7280984a8 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:11:02.146144 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-0707dfae-c9f2-4989-ba3b-dae7280984a8 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] [instance: b5682421-8a91-43a1-88fb-8d2a158ad6d7] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:11:02.153863 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-0707dfae-c9f2-4989-ba3b-dae7280984a8 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:11:02.154356 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-0707dfae-c9f2-4989-ba3b-dae7280984a8 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:11:02.155159 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-0707dfae-c9f2-4989-ba3b-dae7280984a8 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:11:02.155600 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-0707dfae-c9f2-4989-ba3b-dae7280984a8 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:11:02.452709 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-0707dfae-c9f2-4989-ba3b-dae7280984a8 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2697aa77265e4f5783f87ffb3d4992b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1423c05c42b14519b401e22e16062781', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:11:02.460330 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-0707dfae-c9f2-4989-ba3b-dae7280984a8 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] 10.222.0.17 "GET /compute/v2.1/servers/b5682421-8a91-43a1-88fb-8d2a158ad6d7" status: 200 len: 1265 microversion: 2.1 time: 0.319866 Jun 16 23:11:02.460888 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 556/1098] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:11:02 2022] GET /compute/v2.1/servers/b5682421-8a91-43a1-88fb-8d2a158ad6d7 => generated 1265 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:11:03.478227 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-777dc1dd-8aea-447c-a915-99b880b4e7d1 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:11:03.478944 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-777dc1dd-8aea-447c-a915-99b880b4e7d1 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] [instance: b5682421-8a91-43a1-88fb-8d2a158ad6d7] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:11:03.486272 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-777dc1dd-8aea-447c-a915-99b880b4e7d1 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:11:03.486752 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-777dc1dd-8aea-447c-a915-99b880b4e7d1 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:11:03.487517 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-777dc1dd-8aea-447c-a915-99b880b4e7d1 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:11:03.487950 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-777dc1dd-8aea-447c-a915-99b880b4e7d1 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:11:03.699393 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-777dc1dd-8aea-447c-a915-99b880b4e7d1 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2697aa77265e4f5783f87ffb3d4992b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1423c05c42b14519b401e22e16062781', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:11:03.706863 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-777dc1dd-8aea-447c-a915-99b880b4e7d1 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] 10.222.0.17 "GET /compute/v2.1/servers/b5682421-8a91-43a1-88fb-8d2a158ad6d7" status: 200 len: 1265 microversion: 2.1 time: 0.234171 Jun 16 23:11:03.707434 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 543/1099] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:11:03 2022] GET /compute/v2.1/servers/b5682421-8a91-43a1-88fb-8d2a158ad6d7 => generated 1265 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:11:04.723869 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-9863d6ec-4d41-4e56-9ed5-99f56e66620f tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:11:04.725083 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-9863d6ec-4d41-4e56-9ed5-99f56e66620f tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] [instance: b5682421-8a91-43a1-88fb-8d2a158ad6d7] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:11:04.732064 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-9863d6ec-4d41-4e56-9ed5-99f56e66620f tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:11:04.732520 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-9863d6ec-4d41-4e56-9ed5-99f56e66620f tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:11:04.733290 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-9863d6ec-4d41-4e56-9ed5-99f56e66620f tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:11:04.733737 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-9863d6ec-4d41-4e56-9ed5-99f56e66620f tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:11:04.899414 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-9863d6ec-4d41-4e56-9ed5-99f56e66620f tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2697aa77265e4f5783f87ffb3d4992b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1423c05c42b14519b401e22e16062781', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:11:04.908735 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-9863d6ec-4d41-4e56-9ed5-99f56e66620f tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] 10.222.0.17 "GET /compute/v2.1/servers/b5682421-8a91-43a1-88fb-8d2a158ad6d7" status: 200 len: 1265 microversion: 2.1 time: 0.188637 Jun 16 23:11:04.910628 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 557/1100] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:11:04 2022] GET /compute/v2.1/servers/b5682421-8a91-43a1-88fb-8d2a158ad6d7 => generated 1265 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:11:05.925435 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-7f08b7c7-5f82-4f72-a566-7ccf0a53e801 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:11:05.926043 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-7f08b7c7-5f82-4f72-a566-7ccf0a53e801 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] [instance: b5682421-8a91-43a1-88fb-8d2a158ad6d7] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:11:05.932972 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-7f08b7c7-5f82-4f72-a566-7ccf0a53e801 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:11:05.933417 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-7f08b7c7-5f82-4f72-a566-7ccf0a53e801 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:11:05.934368 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-7f08b7c7-5f82-4f72-a566-7ccf0a53e801 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:11:05.934834 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-7f08b7c7-5f82-4f72-a566-7ccf0a53e801 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:11:06.416265 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-7f08b7c7-5f82-4f72-a566-7ccf0a53e801 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2697aa77265e4f5783f87ffb3d4992b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1423c05c42b14519b401e22e16062781', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:11:06.423730 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-7f08b7c7-5f82-4f72-a566-7ccf0a53e801 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] 10.222.0.17 "GET /compute/v2.1/servers/b5682421-8a91-43a1-88fb-8d2a158ad6d7" status: 200 len: 1265 microversion: 2.1 time: 0.502309 Jun 16 23:11:06.424291 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 544/1101] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:11:05 2022] GET /compute/v2.1/servers/b5682421-8a91-43a1-88fb-8d2a158ad6d7 => generated 1265 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:11:07.442308 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-c6b4bbb5-1318-47dd-b37e-be44d98b61ea tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:11:07.443057 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-c6b4bbb5-1318-47dd-b37e-be44d98b61ea tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] [instance: b5682421-8a91-43a1-88fb-8d2a158ad6d7] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:11:07.451161 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-c6b4bbb5-1318-47dd-b37e-be44d98b61ea tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:11:07.451975 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-c6b4bbb5-1318-47dd-b37e-be44d98b61ea tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:11:07.453638 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-c6b4bbb5-1318-47dd-b37e-be44d98b61ea tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:11:07.454281 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-c6b4bbb5-1318-47dd-b37e-be44d98b61ea tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:11:07.740278 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-c6b4bbb5-1318-47dd-b37e-be44d98b61ea tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2697aa77265e4f5783f87ffb3d4992b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1423c05c42b14519b401e22e16062781', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:11:07.748726 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-c6b4bbb5-1318-47dd-b37e-be44d98b61ea tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] 10.222.0.17 "GET /compute/v2.1/servers/b5682421-8a91-43a1-88fb-8d2a158ad6d7" status: 200 len: 1265 microversion: 2.1 time: 0.312005 Jun 16 23:11:07.749295 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 558/1102] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:11:07 2022] GET /compute/v2.1/servers/b5682421-8a91-43a1-88fb-8d2a158ad6d7 => generated 1265 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:11:08.767217 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-40a794fe-fadd-4aaf-8088-463714315b81 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:11:08.767829 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-40a794fe-fadd-4aaf-8088-463714315b81 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] [instance: b5682421-8a91-43a1-88fb-8d2a158ad6d7] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:11:08.770271 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG dbcounter [-] [117563] Writing DB stats nova_cell0:SELECT=2 {{(pid=117563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 23:11:08.771153 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG dbcounter [-] [117563] Writing DB stats nova_cell0:SELECT=8 {{(pid=117563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 23:11:08.777601 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-40a794fe-fadd-4aaf-8088-463714315b81 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:11:08.778089 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-40a794fe-fadd-4aaf-8088-463714315b81 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:11:08.778901 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-40a794fe-fadd-4aaf-8088-463714315b81 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:11:08.779349 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-40a794fe-fadd-4aaf-8088-463714315b81 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:11:08.977255 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-40a794fe-fadd-4aaf-8088-463714315b81 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2697aa77265e4f5783f87ffb3d4992b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1423c05c42b14519b401e22e16062781', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:11:08.984908 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-40a794fe-fadd-4aaf-8088-463714315b81 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] 10.222.0.17 "GET /compute/v2.1/servers/b5682421-8a91-43a1-88fb-8d2a158ad6d7" status: 200 len: 1265 microversion: 2.1 time: 0.221654 Jun 16 23:11:08.985473 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 545/1103] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:11:08 2022] GET /compute/v2.1/servers/b5682421-8a91-43a1-88fb-8d2a158ad6d7 => generated 1265 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:11:10.001114 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-9c2cc284-bdb7-43d7-8d8a-01ddb961a47d tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:11:10.001729 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-9c2cc284-bdb7-43d7-8d8a-01ddb961a47d tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] [instance: b5682421-8a91-43a1-88fb-8d2a158ad6d7] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:11:10.008912 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-9c2cc284-bdb7-43d7-8d8a-01ddb961a47d tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:11:10.009396 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-9c2cc284-bdb7-43d7-8d8a-01ddb961a47d tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:11:10.010165 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-9c2cc284-bdb7-43d7-8d8a-01ddb961a47d tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:11:10.010627 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-9c2cc284-bdb7-43d7-8d8a-01ddb961a47d tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:11:10.141944 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-9c2cc284-bdb7-43d7-8d8a-01ddb961a47d tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2697aa77265e4f5783f87ffb3d4992b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1423c05c42b14519b401e22e16062781', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:11:10.151079 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-9c2cc284-bdb7-43d7-8d8a-01ddb961a47d tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] 10.222.0.17 "GET /compute/v2.1/servers/b5682421-8a91-43a1-88fb-8d2a158ad6d7" status: 200 len: 1265 microversion: 2.1 time: 0.153731 Jun 16 23:11:10.151648 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 559/1104] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:11:09 2022] GET /compute/v2.1/servers/b5682421-8a91-43a1-88fb-8d2a158ad6d7 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:11:10.945947 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [req-ec910a63-8618-4398-9bf8-12fb9242bc2c req-482a0088-ad37-4ac0-a567-2cbcc667932e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5682421-8a91-43a1-88fb-8d2a158ad6d7", "name": "network-vif-plugged", "status": "completed", "tag": "a1370d08-1392-4cb6-ba52-ee441d4147b5"}]} {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 23:11:10.954841 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-ec910a63-8618-4398-9bf8-12fb9242bc2c req-482a0088-ad37-4ac0-a567-2cbcc667932e service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:11:10.955349 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-ec910a63-8618-4398-9bf8-12fb9242bc2c req-482a0088-ad37-4ac0-a567-2cbcc667932e service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:11:10.966810 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.compute.server_external_events [req-ec910a63-8618-4398-9bf8-12fb9242bc2c req-482a0088-ad37-4ac0-a567-2cbcc667932e service nova] Creating event network-vif-plugged:a1370d08-1392-4cb6-ba52-ee441d4147b5 for instance b5682421-8a91-43a1-88fb-8d2a158ad6d7 on hv-cinder-84623 Jun 16 23:11:10.971897 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [req-ec910a63-8618-4398-9bf8-12fb9242bc2c req-482a0088-ad37-4ac0-a567-2cbcc667932e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029636 Jun 16 23:11:10.972658 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 546/1105] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 23:11:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 23:11:11.170286 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-fd3c94f5-3a42-4e79-9c27-ee16c939cb10 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:11:11.170940 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-fd3c94f5-3a42-4e79-9c27-ee16c939cb10 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] [instance: b5682421-8a91-43a1-88fb-8d2a158ad6d7] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:11:11.177349 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-fd3c94f5-3a42-4e79-9c27-ee16c939cb10 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:11:11.177792 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-fd3c94f5-3a42-4e79-9c27-ee16c939cb10 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:11:11.178580 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-fd3c94f5-3a42-4e79-9c27-ee16c939cb10 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:11:11.179593 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-fd3c94f5-3a42-4e79-9c27-ee16c939cb10 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:11:11.323561 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-fd3c94f5-3a42-4e79-9c27-ee16c939cb10 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2697aa77265e4f5783f87ffb3d4992b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1423c05c42b14519b401e22e16062781', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:11:11.330853 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-fd3c94f5-3a42-4e79-9c27-ee16c939cb10 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] 10.222.0.17 "GET /compute/v2.1/servers/b5682421-8a91-43a1-88fb-8d2a158ad6d7" status: 200 len: 1265 microversion: 2.1 time: 0.164404 Jun 16 23:11:11.331398 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 560/1106] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:11:11 2022] GET /compute/v2.1/servers/b5682421-8a91-43a1-88fb-8d2a158ad6d7 => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:11:12.348246 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-71b3357f-fb7c-4919-83cd-948c629ed125 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:11:12.348927 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-71b3357f-fb7c-4919-83cd-948c629ed125 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] [instance: b5682421-8a91-43a1-88fb-8d2a158ad6d7] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:11:12.355733 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-71b3357f-fb7c-4919-83cd-948c629ed125 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:11:12.356200 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-71b3357f-fb7c-4919-83cd-948c629ed125 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:11:12.356956 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-71b3357f-fb7c-4919-83cd-948c629ed125 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:11:12.357386 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-71b3357f-fb7c-4919-83cd-948c629ed125 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:11:12.487144 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-71b3357f-fb7c-4919-83cd-948c629ed125 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2697aa77265e4f5783f87ffb3d4992b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1423c05c42b14519b401e22e16062781', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:11:12.496865 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-71b3357f-fb7c-4919-83cd-948c629ed125 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] 10.222.0.17 "GET /compute/v2.1/servers/b5682421-8a91-43a1-88fb-8d2a158ad6d7" status: 200 len: 1453 microversion: 2.1 time: 0.152468 Jun 16 23:11:12.497442 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 547/1107] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:11:12 2022] GET /compute/v2.1/servers/b5682421-8a91-43a1-88fb-8d2a158ad6d7 => generated 1453 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:11:12.513458 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-b7bc1255-4ca0-4b74-a16b-1234c5b60c6f tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:11:12.514068 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-b7bc1255-4ca0-4b74-a16b-1234c5b60c6f tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] [instance: b5682421-8a91-43a1-88fb-8d2a158ad6d7] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:11:12.520594 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-b7bc1255-4ca0-4b74-a16b-1234c5b60c6f tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:11:12.521046 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-b7bc1255-4ca0-4b74-a16b-1234c5b60c6f tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:11:12.521811 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-b7bc1255-4ca0-4b74-a16b-1234c5b60c6f tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:11:12.522252 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-b7bc1255-4ca0-4b74-a16b-1234c5b60c6f tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:11:12.651629 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-b7bc1255-4ca0-4b74-a16b-1234c5b60c6f tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2697aa77265e4f5783f87ffb3d4992b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1423c05c42b14519b401e22e16062781', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:11:12.659108 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-b7bc1255-4ca0-4b74-a16b-1234c5b60c6f tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] 10.222.0.17 "GET /compute/v2.1/servers/b5682421-8a91-43a1-88fb-8d2a158ad6d7" status: 200 len: 1453 microversion: 2.1 time: 0.149426 Jun 16 23:11:12.659661 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 561/1108] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:11:12 2022] GET /compute/v2.1/servers/b5682421-8a91-43a1-88fb-8d2a158ad6d7 => generated 1453 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:11:14.659677 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [req-891782ac-b8e9-4c75-9306-15b93be0fbbb req-6ac36fe8-0594-4c41-97e0-8828e0dfa4b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5682421-8a91-43a1-88fb-8d2a158ad6d7", "tag": "a1370d08-1392-4cb6-ba52-ee441d4147b5"}]} {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 23:11:14.668003 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-891782ac-b8e9-4c75-9306-15b93be0fbbb req-6ac36fe8-0594-4c41-97e0-8828e0dfa4b2 service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:11:14.668444 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-891782ac-b8e9-4c75-9306-15b93be0fbbb req-6ac36fe8-0594-4c41-97e0-8828e0dfa4b2 service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:11:14.679404 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.compute.server_external_events [req-891782ac-b8e9-4c75-9306-15b93be0fbbb req-6ac36fe8-0594-4c41-97e0-8828e0dfa4b2 service nova] Creating event network-changed:a1370d08-1392-4cb6-ba52-ee441d4147b5 for instance b5682421-8a91-43a1-88fb-8d2a158ad6d7 on hv-cinder-84623 Jun 16 23:11:14.684684 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [req-891782ac-b8e9-4c75-9306-15b93be0fbbb req-6ac36fe8-0594-4c41-97e0-8828e0dfa4b2 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.204688 Jun 16 23:11:14.685274 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 548/1109] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 23:11:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 23:12:23.216814 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 23:12:23.217430 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Thu Jun 16 23:12:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 23:12:27.647741 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 23:12:27.648313 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Thu Jun 16 23:12:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 23:12:43.153647 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG dbcounter [-] [117562] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 23:12:43.154635 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG dbcounter [-] [117562] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 23:12:43.158426 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG dbcounter [-] [117563] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=117563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 23:12:43.158923 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-3787580f-c79c-4d4c-8407-1d5aa57a4c89 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:12:43.159142 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-3787580f-c79c-4d4c-8407-1d5aa57a4c89 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] [instance: b5682421-8a91-43a1-88fb-8d2a158ad6d7] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:12:43.160707 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG dbcounter [-] [117563] Writing DB stats nova_cell1:SELECT=73,nova_cell1:INSERT=1 {{(pid=117563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 23:12:43.167032 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-3787580f-c79c-4d4c-8407-1d5aa57a4c89 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:12:43.167490 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-3787580f-c79c-4d4c-8407-1d5aa57a4c89 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:12:43.168267 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-3787580f-c79c-4d4c-8407-1d5aa57a4c89 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:12:43.168705 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-3787580f-c79c-4d4c-8407-1d5aa57a4c89 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:12:43.169618 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [req-e469ee18-df82-4286-aee9-4622dc60ad33 req-d38e71cd-7c54-4750-97e6-c4fa740da0f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5682421-8a91-43a1-88fb-8d2a158ad6d7", "tag": "a1370d08-1392-4cb6-ba52-ee441d4147b5"}]} {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 23:12:43.180914 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-e469ee18-df82-4286-aee9-4622dc60ad33 req-d38e71cd-7c54-4750-97e6-c4fa740da0f4 service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:12:43.181720 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-e469ee18-df82-4286-aee9-4622dc60ad33 req-d38e71cd-7c54-4750-97e6-c4fa740da0f4 service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:12:43.194389 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.compute.server_external_events [req-e469ee18-df82-4286-aee9-4622dc60ad33 req-d38e71cd-7c54-4750-97e6-c4fa740da0f4 service nova] Creating event network-changed:a1370d08-1392-4cb6-ba52-ee441d4147b5 for instance b5682421-8a91-43a1-88fb-8d2a158ad6d7 on hv-cinder-84623 Jun 16 23:12:43.197073 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-3787580f-c79c-4d4c-8407-1d5aa57a4c89 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] [instance: b5682421-8a91-43a1-88fb-8d2a158ad6d7] Going to try to terminate instance {{(pid=117562) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 23:12:43.199772 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [req-e469ee18-df82-4286-aee9-4622dc60ad33 req-d38e71cd-7c54-4750-97e6-c4fa740da0f4 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044003 Jun 16 23:12:43.203137 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 549/1110] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 23:12:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 23:12:43.279650 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-3787580f-c79c-4d4c-8407-1d5aa57a4c89 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] 10.222.0.17 "DELETE /compute/v2.1/servers/b5682421-8a91-43a1-88fb-8d2a158ad6d7" status: 204 len: 0 microversion: 2.1 time: 0.127753 Jun 16 23:12:43.284348 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 562/1111] 10.222.0.17 () {58 vars in 1238 bytes} [Thu Jun 16 23:12:43 2022] DELETE /compute/v2.1/servers/b5682421-8a91-43a1-88fb-8d2a158ad6d7 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 23:12:43.290926 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-0c50916d-e319-42c7-8d9a-587eefa8b2e7 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:12:43.291642 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-0c50916d-e319-42c7-8d9a-587eefa8b2e7 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] [instance: b5682421-8a91-43a1-88fb-8d2a158ad6d7] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:12:43.302711 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-0c50916d-e319-42c7-8d9a-587eefa8b2e7 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:12:43.303186 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-0c50916d-e319-42c7-8d9a-587eefa8b2e7 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:12:43.303999 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-0c50916d-e319-42c7-8d9a-587eefa8b2e7 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:12:43.304446 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-0c50916d-e319-42c7-8d9a-587eefa8b2e7 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:12:43.482361 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-0c50916d-e319-42c7-8d9a-587eefa8b2e7 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2697aa77265e4f5783f87ffb3d4992b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1423c05c42b14519b401e22e16062781', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:12:43.489890 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-0c50916d-e319-42c7-8d9a-587eefa8b2e7 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] 10.222.0.17 "GET /compute/v2.1/servers/b5682421-8a91-43a1-88fb-8d2a158ad6d7" status: 200 len: 1578 microversion: 2.1 time: 0.204451 Jun 16 23:12:43.490461 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 550/1112] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:12:43 2022] GET /compute/v2.1/servers/b5682421-8a91-43a1-88fb-8d2a158ad6d7 => generated 1578 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:12:44.507729 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-d7fd01d6-59b1-4d94-9257-e7b6567e9de6 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:12:44.508354 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-d7fd01d6-59b1-4d94-9257-e7b6567e9de6 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] [instance: b5682421-8a91-43a1-88fb-8d2a158ad6d7] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:12:44.515054 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-d7fd01d6-59b1-4d94-9257-e7b6567e9de6 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:12:44.515504 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-d7fd01d6-59b1-4d94-9257-e7b6567e9de6 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:12:44.516265 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-d7fd01d6-59b1-4d94-9257-e7b6567e9de6 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:12:44.516698 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-d7fd01d6-59b1-4d94-9257-e7b6567e9de6 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:12:44.689087 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-d7fd01d6-59b1-4d94-9257-e7b6567e9de6 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2697aa77265e4f5783f87ffb3d4992b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1423c05c42b14519b401e22e16062781', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:12:44.696550 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-d7fd01d6-59b1-4d94-9257-e7b6567e9de6 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] 10.222.0.17 "GET /compute/v2.1/servers/b5682421-8a91-43a1-88fb-8d2a158ad6d7" status: 200 len: 1578 microversion: 2.1 time: 0.193032 Jun 16 23:12:44.697108 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 563/1113] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:12:44 2022] GET /compute/v2.1/servers/b5682421-8a91-43a1-88fb-8d2a158ad6d7 => generated 1578 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:12:45.585961 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [req-30bea80c-7656-416f-8d5b-8d671fe4b6a7 req-4b975bfc-6840-4f9f-805f-a56bdf32f81c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5682421-8a91-43a1-88fb-8d2a158ad6d7", "name": "network-vif-deleted", "tag": "a1370d08-1392-4cb6-ba52-ee441d4147b5"}]} {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 23:12:45.593979 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-30bea80c-7656-416f-8d5b-8d671fe4b6a7 req-4b975bfc-6840-4f9f-805f-a56bdf32f81c service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:12:45.594471 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-30bea80c-7656-416f-8d5b-8d671fe4b6a7 req-4b975bfc-6840-4f9f-805f-a56bdf32f81c service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:12:45.605666 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.compute.server_external_events [req-30bea80c-7656-416f-8d5b-8d671fe4b6a7 req-4b975bfc-6840-4f9f-805f-a56bdf32f81c service nova] Creating event network-vif-deleted:a1370d08-1392-4cb6-ba52-ee441d4147b5 for instance b5682421-8a91-43a1-88fb-8d2a158ad6d7 on hv-cinder-84623 Jun 16 23:12:45.610285 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [req-30bea80c-7656-416f-8d5b-8d671fe4b6a7 req-4b975bfc-6840-4f9f-805f-a56bdf32f81c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089948 Jun 16 23:12:45.610889 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 551/1114] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 23:12:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 23:12:45.712693 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-4be5ef27-e1c3-42c9-9581-77c140cf3dfb tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:12:45.713239 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-4be5ef27-e1c3-42c9-9581-77c140cf3dfb tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] [instance: b5682421-8a91-43a1-88fb-8d2a158ad6d7] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:12:45.719712 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-4be5ef27-e1c3-42c9-9581-77c140cf3dfb tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:12:45.720165 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-4be5ef27-e1c3-42c9-9581-77c140cf3dfb tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:12:45.721087 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-4be5ef27-e1c3-42c9-9581-77c140cf3dfb tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:12:45.721549 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-4be5ef27-e1c3-42c9-9581-77c140cf3dfb tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:12:45.784971 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-4be5ef27-e1c3-42c9-9581-77c140cf3dfb tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2697aa77265e4f5783f87ffb3d4992b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1423c05c42b14519b401e22e16062781', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:12:45.793708 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-4be5ef27-e1c3-42c9-9581-77c140cf3dfb tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] 10.222.0.17 "GET /compute/v2.1/servers/b5682421-8a91-43a1-88fb-8d2a158ad6d7" status: 200 len: 1225 microversion: 2.1 time: 0.084817 Jun 16 23:12:45.794453 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 564/1115] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:12:45 2022] GET /compute/v2.1/servers/b5682421-8a91-43a1-88fb-8d2a158ad6d7 => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:12:46.812102 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-c6f7bcff-f923-480f-83b2-a0089491dd4a tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:12:46.812810 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-c6f7bcff-f923-480f-83b2-a0089491dd4a tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] [instance: b5682421-8a91-43a1-88fb-8d2a158ad6d7] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:12:46.819620 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-c6f7bcff-f923-480f-83b2-a0089491dd4a tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:12:46.820070 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-c6f7bcff-f923-480f-83b2-a0089491dd4a tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:12:46.820828 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-c6f7bcff-f923-480f-83b2-a0089491dd4a tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:12:46.821260 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-c6f7bcff-f923-480f-83b2-a0089491dd4a tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:12:46.833841 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.wsgi [None req-c6f7bcff-f923-480f-83b2-a0089491dd4a tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] HTTP exception thrown: Instance b5682421-8a91-43a1-88fb-8d2a158ad6d7 could not be found. Jun 16 23:12:46.835446 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-c6f7bcff-f923-480f-83b2-a0089491dd4a tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Request method failure captured: Jun 16 23:12:46.835446 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: request: GET /compute/v2.1/servers/b5682421-8a91-43a1-88fb-8d2a158ad6d7 HTTP/1.1 Jun 16 23:12:46.835446 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Accept: application/json Jun 16 23:12:46.835446 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Accept-Encoding: identity Jun 16 23:12:46.835446 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Connection: close Jun 16 23:12:46.835446 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Content-Length: 0 Jun 16 23:12:46.835446 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Content-Type: application/json Jun 16 23:12:46.835446 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Host: 10.222.0.17 Jun 16 23:12:46.835446 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Openstack-System-Scope: None Jun 16 23:12:46.835446 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: User-Agent: python-urllib3/1.26.9 Jun 16 23:12:46.835446 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Auth-Token: gAAAAABiq7dOTghxs_tntnNw6zIutFbhuM_ZrhXS_oTJGir2L7J96wc3GKbm_J5OvoayLMAwFR1CjQYDc_2fXeoXZ4wNuz4d_4FTDnPB953kS8XJuq31Uqz3xWu_VRxj_3nnOvVSKaz5t6cgTkeIf1ytphRKjBn_xLSR7dMTyeUq9Y_QtMiIm9c Jun 16 23:12:46.835446 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Domain-Id: None Jun 16 23:12:46.835446 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Domain-Name: None Jun 16 23:12:46.835446 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Identity-Status: Confirmed Jun 16 23:12:46.835446 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Is-Admin-Project: True Jun 16 23:12:46.835446 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Project-Domain-Id: default Jun 16 23:12:46.835446 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Project-Domain-Name: Default Jun 16 23:12:46.835446 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Project-Id: 1423c05c42b14519b401e22e16062781 Jun 16 23:12:46.835446 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Project-Name: tempest-TestVolumeBootPattern-591009407 Jun 16 23:12:46.835446 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Role: member,reader Jun 16 23:12:46.835446 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Roles: member,reader Jun 16 23:12:46.837111 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/1423c05c42b14519b401e22e16062781"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_1423c05c42b14519b401e22e16062781"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1423c05c42b14519b401e22e16062781"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1423c05c42b14519b401e22e16062781"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Jun 16 23:12:46.837111 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Tenant: tempest-TestVolumeBootPattern-591009407 Jun 16 23:12:46.837111 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Tenant-Id: 1423c05c42b14519b401e22e16062781 Jun 16 23:12:46.837111 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Tenant-Name: tempest-TestVolumeBootPattern-591009407 Jun 16 23:12:46.837111 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-User: tempest-TestVolumeBootPattern-591009407-project Jun 16 23:12:46.837111 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-User-Domain-Id: default Jun 16 23:12:46.837111 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-User-Domain-Name: Default Jun 16 23:12:46.837111 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-User-Id: 2697aa77265e4f5783f87ffb3d4992b5 Jun 16 23:12:46.837111 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-User-Name: tempest-TestVolumeBootPattern-591009407-project Jun 16 23:12:46.837111 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: method: > Jun 16 23:12:46.837111 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: exception: Instance b5682421-8a91-43a1-88fb-8d2a158ad6d7 could not be found. Jun 16 23:12:46.837111 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: action_args: {'id': 'b5682421-8a91-43a1-88fb-8d2a158ad6d7'} Jun 16 23:12:46.838105 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 23:12:46.838105 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 23:12:46.838105 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 23:12:46.838105 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 23:12:46.838105 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 23:12:46.838105 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 23:12:46.838105 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 23:12:46.838105 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 23:12:46.838105 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 23:12:46.838105 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 23:12:46.838105 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b5682421-8a91-43a1-88fb-8d2a158ad6d7 could not be found. Jun 16 23:12:46.838105 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 16 23:12:46.838105 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 23:12:46.838105 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 16 23:12:46.838105 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 23:12:46.838105 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 23:12:46.838105 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 23:12:46.838105 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 23:12:46.838105 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 23:12:46.838105 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 23:12:46.839715 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 23:12:46.839715 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 23:12:46.839715 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 23:12:46.839715 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 23:12:46.839715 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 23:12:46.839715 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 23:12:46.839715 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 23:12:46.839715 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b5682421-8a91-43a1-88fb-8d2a158ad6d7 could not be found. Jun 16 23:12:46.839715 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 16 23:12:46.839715 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 23:12:46.839715 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 16 23:12:46.839715 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 23:12:46.839715 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 23:12:46.839715 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 23:12:46.839715 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 23:12:46.839715 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 23:12:46.839715 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b5682421-8a91-43a1-88fb-8d2a158ad6d7 could not be found. Jun 16 23:12:46.839715 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 16 23:12:46.841536 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-c6f7bcff-f923-480f-83b2-a0089491dd4a tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Returning 404 to user: Instance b5682421-8a91-43a1-88fb-8d2a158ad6d7 could not be found. {{(pid=117563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 23:12:46.841536 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-c6f7bcff-f923-480f-83b2-a0089491dd4a tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] 10.222.0.17 "GET /compute/v2.1/servers/b5682421-8a91-43a1-88fb-8d2a158ad6d7" status: 404 len: 111 microversion: 2.1 time: 0.029329 Jun 16 23:12:46.841536 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 552/1116] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:12:46 2022] GET /compute/v2.1/servers/b5682421-8a91-43a1-88fb-8d2a158ad6d7 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 23:12:49.860098 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-c3028d25-135f-4237-b2f5-af57c46f02eb tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:12:49.860734 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-c3028d25-135f-4237-b2f5-af57c46f02eb tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] [instance: 6fe2cc96-6822-4aa3-9dbf-169d3a688f3a] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:12:49.862228 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [req-86de89e0-39c2-4c0b-97b9-a17687a20454 req-464a2769-ade6-4536-8658-f7800409c4a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6fe2cc96-6822-4aa3-9dbf-169d3a688f3a", "tag": "3d02cfeb-d784-4f09-9198-cae370fc9285"}]} {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 23:12:49.867771 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-c3028d25-135f-4237-b2f5-af57c46f02eb tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:12:49.868456 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-c3028d25-135f-4237-b2f5-af57c46f02eb tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:12:49.869443 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-c3028d25-135f-4237-b2f5-af57c46f02eb tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:12:49.869879 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-c3028d25-135f-4237-b2f5-af57c46f02eb tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:12:49.871565 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-86de89e0-39c2-4c0b-97b9-a17687a20454 req-464a2769-ade6-4536-8658-f7800409c4a2 service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:12:49.872004 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-86de89e0-39c2-4c0b-97b9-a17687a20454 req-464a2769-ade6-4536-8658-f7800409c4a2 service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:12:49.883740 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.compute.server_external_events [req-86de89e0-39c2-4c0b-97b9-a17687a20454 req-464a2769-ade6-4536-8658-f7800409c4a2 service nova] Creating event network-changed:3d02cfeb-d784-4f09-9198-cae370fc9285 for instance 6fe2cc96-6822-4aa3-9dbf-169d3a688f3a on hv-cinder-84623 Jun 16 23:12:49.888947 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [req-86de89e0-39c2-4c0b-97b9-a17687a20454 req-464a2769-ade6-4536-8658-f7800409c4a2 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030499 Jun 16 23:12:49.890050 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 553/1117] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 23:12:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 23:12:49.895938 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-c3028d25-135f-4237-b2f5-af57c46f02eb tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] [instance: 6fe2cc96-6822-4aa3-9dbf-169d3a688f3a] Going to try to terminate instance {{(pid=117562) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 23:12:49.980339 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-c3028d25-135f-4237-b2f5-af57c46f02eb tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] 10.222.0.17 "DELETE /compute/v2.1/servers/6fe2cc96-6822-4aa3-9dbf-169d3a688f3a" status: 204 len: 0 microversion: 2.1 time: 0.123769 Jun 16 23:12:49.984362 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 565/1118] 10.222.0.17 () {58 vars in 1238 bytes} [Thu Jun 16 23:12:49 2022] DELETE /compute/v2.1/servers/6fe2cc96-6822-4aa3-9dbf-169d3a688f3a => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 23:12:49.992560 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-a07c2942-cc6d-40f3-a04e-04c4b36cf405 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:12:49.993639 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-a07c2942-cc6d-40f3-a04e-04c4b36cf405 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] [instance: 6fe2cc96-6822-4aa3-9dbf-169d3a688f3a] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:12:50.000400 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-a07c2942-cc6d-40f3-a04e-04c4b36cf405 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:12:50.001127 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-a07c2942-cc6d-40f3-a04e-04c4b36cf405 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:12:50.002168 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-a07c2942-cc6d-40f3-a04e-04c4b36cf405 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:12:50.002847 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-a07c2942-cc6d-40f3-a04e-04c4b36cf405 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:12:50.137329 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.policy [None req-a07c2942-cc6d-40f3-a04e-04c4b36cf405 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2697aa77265e4f5783f87ffb3d4992b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1423c05c42b14519b401e22e16062781', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117563) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:12:50.144801 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-a07c2942-cc6d-40f3-a04e-04c4b36cf405 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] 10.222.0.17 "GET /compute/v2.1/servers/6fe2cc96-6822-4aa3-9dbf-169d3a688f3a" status: 200 len: 1576 microversion: 2.1 time: 0.158720 Jun 16 23:12:50.145398 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 554/1119] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:12:49 2022] GET /compute/v2.1/servers/6fe2cc96-6822-4aa3-9dbf-169d3a688f3a => generated 1576 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:12:51.163203 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-4b551837-3551-4d19-8e9c-d7d45464576a tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:12:51.163910 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-4b551837-3551-4d19-8e9c-d7d45464576a tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] [instance: 6fe2cc96-6822-4aa3-9dbf-169d3a688f3a] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:12:51.170701 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-4b551837-3551-4d19-8e9c-d7d45464576a tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:12:51.171157 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-4b551837-3551-4d19-8e9c-d7d45464576a tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:12:51.172189 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-4b551837-3551-4d19-8e9c-d7d45464576a tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:12:51.172628 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-4b551837-3551-4d19-8e9c-d7d45464576a tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:12:51.308421 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-4b551837-3551-4d19-8e9c-d7d45464576a tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2697aa77265e4f5783f87ffb3d4992b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1423c05c42b14519b401e22e16062781', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:12:51.316537 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-4b551837-3551-4d19-8e9c-d7d45464576a tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] 10.222.0.17 "GET /compute/v2.1/servers/6fe2cc96-6822-4aa3-9dbf-169d3a688f3a" status: 200 len: 1576 microversion: 2.1 time: 0.158273 Jun 16 23:12:51.317372 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 566/1120] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:12:51 2022] GET /compute/v2.1/servers/6fe2cc96-6822-4aa3-9dbf-169d3a688f3a => generated 1576 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:12:52.235788 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [req-04e34608-2b65-47ad-a884-ca7b37d05ae7 req-253f2a81-8369-43d8-9311-60a22c89fa52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6fe2cc96-6822-4aa3-9dbf-169d3a688f3a", "name": "network-vif-deleted", "tag": "3d02cfeb-d784-4f09-9198-cae370fc9285"}]} {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 23:12:52.245915 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-04e34608-2b65-47ad-a884-ca7b37d05ae7 req-253f2a81-8369-43d8-9311-60a22c89fa52 service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:12:52.246780 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [req-04e34608-2b65-47ad-a884-ca7b37d05ae7 req-253f2a81-8369-43d8-9311-60a22c89fa52 service nova] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:12:52.259072 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.compute.server_external_events [req-04e34608-2b65-47ad-a884-ca7b37d05ae7 req-253f2a81-8369-43d8-9311-60a22c89fa52 service nova] Creating event network-vif-deleted:3d02cfeb-d784-4f09-9198-cae370fc9285 for instance 6fe2cc96-6822-4aa3-9dbf-169d3a688f3a on hv-cinder-84623 Jun 16 23:12:52.264417 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [req-04e34608-2b65-47ad-a884-ca7b37d05ae7 req-253f2a81-8369-43d8-9311-60a22c89fa52 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032258 Jun 16 23:12:52.265002 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 555/1121] 10.222.0.17 () {64 vars in 1317 bytes} [Thu Jun 16 23:12:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 23:12:52.333135 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-4b6f22a0-5b64-4bca-9ff3-edcd18e1b188 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:12:52.333736 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-4b6f22a0-5b64-4bca-9ff3-edcd18e1b188 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] [instance: 6fe2cc96-6822-4aa3-9dbf-169d3a688f3a] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:12:52.340163 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-4b6f22a0-5b64-4bca-9ff3-edcd18e1b188 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:12:52.340610 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-4b6f22a0-5b64-4bca-9ff3-edcd18e1b188 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:12:52.341362 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-4b6f22a0-5b64-4bca-9ff3-edcd18e1b188 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:12:52.341793 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-4b6f22a0-5b64-4bca-9ff3-edcd18e1b188 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:12:52.401964 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.policy [None req-4b6f22a0-5b64-4bca-9ff3-edcd18e1b188 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2697aa77265e4f5783f87ffb3d4992b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1423c05c42b14519b401e22e16062781', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117562) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 23:12:52.409418 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-4b6f22a0-5b64-4bca-9ff3-edcd18e1b188 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] 10.222.0.17 "GET /compute/v2.1/servers/6fe2cc96-6822-4aa3-9dbf-169d3a688f3a" status: 200 len: 1225 microversion: 2.1 time: 0.080117 Jun 16 23:12:52.409979 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 567/1122] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:12:52 2022] GET /compute/v2.1/servers/6fe2cc96-6822-4aa3-9dbf-169d3a688f3a => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 23:12:53.426374 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-6e6c2582-2701-4353-8b63-625e5963b5e3 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:12:53.427082 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-6e6c2582-2701-4353-8b63-625e5963b5e3 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] [instance: 6fe2cc96-6822-4aa3-9dbf-169d3a688f3a] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:12:53.433771 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-6e6c2582-2701-4353-8b63-625e5963b5e3 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:12:53.434213 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-6e6c2582-2701-4353-8b63-625e5963b5e3 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:12:53.434990 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-6e6c2582-2701-4353-8b63-625e5963b5e3 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:12:53.435423 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-6e6c2582-2701-4353-8b63-625e5963b5e3 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:12:53.448661 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.wsgi [None req-6e6c2582-2701-4353-8b63-625e5963b5e3 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] HTTP exception thrown: Instance 6fe2cc96-6822-4aa3-9dbf-169d3a688f3a could not be found. Jun 16 23:12:53.450211 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-6e6c2582-2701-4353-8b63-625e5963b5e3 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Request method failure captured: Jun 16 23:12:53.450211 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: request: GET /compute/v2.1/servers/6fe2cc96-6822-4aa3-9dbf-169d3a688f3a HTTP/1.1 Jun 16 23:12:53.450211 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Accept: application/json Jun 16 23:12:53.450211 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Accept-Encoding: identity Jun 16 23:12:53.450211 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Connection: close Jun 16 23:12:53.450211 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Content-Length: 0 Jun 16 23:12:53.450211 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Content-Type: application/json Jun 16 23:12:53.450211 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Host: 10.222.0.17 Jun 16 23:12:53.450211 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Openstack-System-Scope: None Jun 16 23:12:53.450211 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: User-Agent: python-urllib3/1.26.9 Jun 16 23:12:53.450211 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Auth-Token: gAAAAABiq7dOTghxs_tntnNw6zIutFbhuM_ZrhXS_oTJGir2L7J96wc3GKbm_J5OvoayLMAwFR1CjQYDc_2fXeoXZ4wNuz4d_4FTDnPB953kS8XJuq31Uqz3xWu_VRxj_3nnOvVSKaz5t6cgTkeIf1ytphRKjBn_xLSR7dMTyeUq9Y_QtMiIm9c Jun 16 23:12:53.450211 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Domain-Id: None Jun 16 23:12:53.450211 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Domain-Name: None Jun 16 23:12:53.450211 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Identity-Status: Confirmed Jun 16 23:12:53.450211 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Is-Admin-Project: True Jun 16 23:12:53.450211 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Project-Domain-Id: default Jun 16 23:12:53.450211 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Project-Domain-Name: Default Jun 16 23:12:53.450211 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Project-Id: 1423c05c42b14519b401e22e16062781 Jun 16 23:12:53.450211 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Project-Name: tempest-TestVolumeBootPattern-591009407 Jun 16 23:12:53.450211 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Role: member,reader Jun 16 23:12:53.450211 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Roles: member,reader Jun 16 23:12:53.451878 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/1423c05c42b14519b401e22e16062781"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_1423c05c42b14519b401e22e16062781"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1423c05c42b14519b401e22e16062781"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1423c05c42b14519b401e22e16062781"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Jun 16 23:12:53.451878 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Tenant: tempest-TestVolumeBootPattern-591009407 Jun 16 23:12:53.451878 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Tenant-Id: 1423c05c42b14519b401e22e16062781 Jun 16 23:12:53.451878 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Tenant-Name: tempest-TestVolumeBootPattern-591009407 Jun 16 23:12:53.451878 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-User: tempest-TestVolumeBootPattern-591009407-project Jun 16 23:12:53.451878 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-User-Domain-Id: default Jun 16 23:12:53.451878 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-User-Domain-Name: Default Jun 16 23:12:53.451878 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-User-Id: 2697aa77265e4f5783f87ffb3d4992b5 Jun 16 23:12:53.451878 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-User-Name: tempest-TestVolumeBootPattern-591009407-project Jun 16 23:12:53.451878 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: method: > Jun 16 23:12:53.451878 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: exception: Instance 6fe2cc96-6822-4aa3-9dbf-169d3a688f3a could not be found. Jun 16 23:12:53.451878 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: action_args: {'id': '6fe2cc96-6822-4aa3-9dbf-169d3a688f3a'} Jun 16 23:12:53.452890 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 23:12:53.452890 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 23:12:53.452890 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 23:12:53.452890 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 23:12:53.452890 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 23:12:53.452890 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 23:12:53.452890 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 23:12:53.452890 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 23:12:53.452890 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 23:12:53.452890 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 23:12:53.452890 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6fe2cc96-6822-4aa3-9dbf-169d3a688f3a could not be found. Jun 16 23:12:53.452890 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 16 23:12:53.452890 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 23:12:53.452890 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 16 23:12:53.452890 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 23:12:53.452890 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 23:12:53.452890 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 23:12:53.452890 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 23:12:53.452890 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 23:12:53.452890 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 23:12:53.454430 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 23:12:53.454430 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 23:12:53.454430 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 23:12:53.454430 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 23:12:53.454430 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 23:12:53.454430 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 23:12:53.454430 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 23:12:53.454430 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6fe2cc96-6822-4aa3-9dbf-169d3a688f3a could not be found. Jun 16 23:12:53.454430 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 16 23:12:53.454430 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 23:12:53.454430 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 16 23:12:53.454430 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 23:12:53.454430 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 23:12:53.454430 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 23:12:53.454430 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 23:12:53.454430 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 23:12:53.454430 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6fe2cc96-6822-4aa3-9dbf-169d3a688f3a could not be found. Jun 16 23:12:53.454430 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 16 23:12:53.456070 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-6e6c2582-2701-4353-8b63-625e5963b5e3 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Returning 404 to user: Instance 6fe2cc96-6822-4aa3-9dbf-169d3a688f3a could not be found. {{(pid=117563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 23:12:53.456070 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-6e6c2582-2701-4353-8b63-625e5963b5e3 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] 10.222.0.17 "GET /compute/v2.1/servers/6fe2cc96-6822-4aa3-9dbf-169d3a688f3a" status: 404 len: 111 microversion: 2.1 time: 0.029651 Jun 16 23:12:53.456070 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 556/1123] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:12:53 2022] GET /compute/v2.1/servers/6fe2cc96-6822-4aa3-9dbf-169d3a688f3a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 23:12:54.131811 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-13a906cb-6977-40d4-bbdc-32b9913e7ce7 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Calling method '>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:12:54.132287 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.compute.api [None req-13a906cb-6977-40d4-bbdc-32b9913e7ce7 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] [instance: bf5049e3-3446-468a-a334-d87825e50af4] Fetching instance by UUID {{(pid=117562) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:12:54.138775 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-13a906cb-6977-40d4-bbdc-32b9913e7ce7 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:12:54.139225 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-13a906cb-6977-40d4-bbdc-32b9913e7ce7 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:12:54.139979 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-13a906cb-6977-40d4-bbdc-32b9913e7ce7 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:12:54.140413 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG oslo_concurrency.lockutils [None req-13a906cb-6977-40d4-bbdc-32b9913e7ce7 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117562) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:12:54.153147 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.wsgi [None req-13a906cb-6977-40d4-bbdc-32b9913e7ce7 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] HTTP exception thrown: Instance bf5049e3-3446-468a-a334-d87825e50af4 could not be found. Jun 16 23:12:54.154801 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-13a906cb-6977-40d4-bbdc-32b9913e7ce7 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Request method failure captured: Jun 16 23:12:54.154801 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: request: DELETE /compute/v2.1/servers/bf5049e3-3446-468a-a334-d87825e50af4 HTTP/1.1 Jun 16 23:12:54.154801 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Accept: application/json Jun 16 23:12:54.154801 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Accept-Encoding: identity Jun 16 23:12:54.154801 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Connection: close Jun 16 23:12:54.154801 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Content-Length: 0 Jun 16 23:12:54.154801 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Content-Type: application/json Jun 16 23:12:54.154801 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Host: 10.222.0.17 Jun 16 23:12:54.154801 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Openstack-System-Scope: None Jun 16 23:12:54.154801 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: User-Agent: python-urllib3/1.26.9 Jun 16 23:12:54.154801 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Auth-Token: gAAAAABiq7dOTghxs_tntnNw6zIutFbhuM_ZrhXS_oTJGir2L7J96wc3GKbm_J5OvoayLMAwFR1CjQYDc_2fXeoXZ4wNuz4d_4FTDnPB953kS8XJuq31Uqz3xWu_VRxj_3nnOvVSKaz5t6cgTkeIf1ytphRKjBn_xLSR7dMTyeUq9Y_QtMiIm9c Jun 16 23:12:54.154801 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Domain-Id: None Jun 16 23:12:54.154801 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Domain-Name: None Jun 16 23:12:54.154801 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Identity-Status: Confirmed Jun 16 23:12:54.154801 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Is-Admin-Project: True Jun 16 23:12:54.154801 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Project-Domain-Id: default Jun 16 23:12:54.154801 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Project-Domain-Name: Default Jun 16 23:12:54.154801 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Project-Id: 1423c05c42b14519b401e22e16062781 Jun 16 23:12:54.154801 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Project-Name: tempest-TestVolumeBootPattern-591009407 Jun 16 23:12:54.154801 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Role: member,reader Jun 16 23:12:54.154801 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Roles: member,reader Jun 16 23:12:54.156389 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/1423c05c42b14519b401e22e16062781"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_1423c05c42b14519b401e22e16062781"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1423c05c42b14519b401e22e16062781"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1423c05c42b14519b401e22e16062781"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Jun 16 23:12:54.156389 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Tenant: tempest-TestVolumeBootPattern-591009407 Jun 16 23:12:54.156389 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Tenant-Id: 1423c05c42b14519b401e22e16062781 Jun 16 23:12:54.156389 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-Tenant-Name: tempest-TestVolumeBootPattern-591009407 Jun 16 23:12:54.156389 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-User: tempest-TestVolumeBootPattern-591009407-project Jun 16 23:12:54.156389 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-User-Domain-Id: default Jun 16 23:12:54.156389 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-User-Domain-Name: Default Jun 16 23:12:54.156389 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-User-Id: 2697aa77265e4f5783f87ffb3d4992b5 Jun 16 23:12:54.156389 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: X-User-Name: tempest-TestVolumeBootPattern-591009407-project Jun 16 23:12:54.156389 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: method: > Jun 16 23:12:54.156389 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: exception: Instance bf5049e3-3446-468a-a334-d87825e50af4 could not be found. Jun 16 23:12:54.156389 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: action_args: {'id': 'bf5049e3-3446-468a-a334-d87825e50af4'} Jun 16 23:12:54.157507 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 23:12:54.157507 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 23:12:54.157507 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 23:12:54.157507 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 23:12:54.157507 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 23:12:54.157507 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 23:12:54.157507 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 23:12:54.157507 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 23:12:54.157507 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 23:12:54.157507 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 23:12:54.157507 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf5049e3-3446-468a-a334-d87825e50af4 could not be found. Jun 16 23:12:54.157507 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Jun 16 23:12:54.157507 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 23:12:54.157507 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Jun 16 23:12:54.157507 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 23:12:54.157507 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 23:12:54.157507 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 23:12:54.157507 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 23:12:54.157507 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 23:12:54.157507 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 23:12:54.159022 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 23:12:54.159022 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 23:12:54.159022 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 23:12:54.159022 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 23:12:54.159022 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 23:12:54.159022 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 23:12:54.159022 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 23:12:54.159022 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 23:12:54.159022 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 23:12:54.159022 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf5049e3-3446-468a-a334-d87825e50af4 could not be found. Jun 16 23:12:54.159022 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Jun 16 23:12:54.159022 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 23:12:54.159022 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Jun 16 23:12:54.159022 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 23:12:54.159022 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 23:12:54.159022 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 23:12:54.159022 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 23:12:54.159022 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 23:12:54.159022 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf5049e3-3446-468a-a334-d87825e50af4 could not be found. Jun 16 23:12:54.159022 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: ERROR nova.api.openstack.wsgi Jun 16 23:12:54.161270 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-13a906cb-6977-40d4-bbdc-32b9913e7ce7 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Returning 404 to user: Instance bf5049e3-3446-468a-a334-d87825e50af4 could not be found. {{(pid=117562) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 23:12:54.161270 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-13a906cb-6977-40d4-bbdc-32b9913e7ce7 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] 10.222.0.17 "DELETE /compute/v2.1/servers/bf5049e3-3446-468a-a334-d87825e50af4" status: 404 len: 111 microversion: 2.1 time: 0.028394 Jun 16 23:12:54.161270 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 568/1124] 10.222.0.17 () {58 vars in 1238 bytes} [Thu Jun 16 23:12:54 2022] DELETE /compute/v2.1/servers/bf5049e3-3446-468a-a334-d87825e50af4 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 23:12:54.165153 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-f31a36c3-0b10-453b-a366-9d95c523d147 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Calling method '>' {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:12:54.165780 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.compute.api [None req-f31a36c3-0b10-453b-a366-9d95c523d147 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] [instance: bf5049e3-3446-468a-a334-d87825e50af4] Fetching instance by UUID {{(pid=117563) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 23:12:54.172034 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-f31a36c3-0b10-453b-a366-9d95c523d147 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:12:54.172479 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-f31a36c3-0b10-453b-a366-9d95c523d147 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:12:54.173229 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-f31a36c3-0b10-453b-a366-9d95c523d147 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 23:12:54.173658 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG oslo_concurrency.lockutils [None req-f31a36c3-0b10-453b-a366-9d95c523d147 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Lock "5f428d07-ff1a-4378-acf2-68efcfdb27a3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117563) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 23:12:54.187195 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.wsgi [None req-f31a36c3-0b10-453b-a366-9d95c523d147 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] HTTP exception thrown: Instance bf5049e3-3446-468a-a334-d87825e50af4 could not be found. Jun 16 23:12:54.188662 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-f31a36c3-0b10-453b-a366-9d95c523d147 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Request method failure captured: Jun 16 23:12:54.188662 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: request: GET /compute/v2.1/servers/bf5049e3-3446-468a-a334-d87825e50af4 HTTP/1.1 Jun 16 23:12:54.188662 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Accept: application/json Jun 16 23:12:54.188662 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Accept-Encoding: identity Jun 16 23:12:54.188662 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Connection: close Jun 16 23:12:54.188662 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Content-Length: 0 Jun 16 23:12:54.188662 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Content-Type: application/json Jun 16 23:12:54.188662 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Host: 10.222.0.17 Jun 16 23:12:54.188662 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Openstack-System-Scope: None Jun 16 23:12:54.188662 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: User-Agent: python-urllib3/1.26.9 Jun 16 23:12:54.188662 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Auth-Token: gAAAAABiq7dOTghxs_tntnNw6zIutFbhuM_ZrhXS_oTJGir2L7J96wc3GKbm_J5OvoayLMAwFR1CjQYDc_2fXeoXZ4wNuz4d_4FTDnPB953kS8XJuq31Uqz3xWu_VRxj_3nnOvVSKaz5t6cgTkeIf1ytphRKjBn_xLSR7dMTyeUq9Y_QtMiIm9c Jun 16 23:12:54.188662 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Domain-Id: None Jun 16 23:12:54.188662 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Domain-Name: None Jun 16 23:12:54.188662 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Identity-Status: Confirmed Jun 16 23:12:54.188662 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Is-Admin-Project: True Jun 16 23:12:54.188662 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Project-Domain-Id: default Jun 16 23:12:54.188662 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Project-Domain-Name: Default Jun 16 23:12:54.188662 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Project-Id: 1423c05c42b14519b401e22e16062781 Jun 16 23:12:54.188662 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Project-Name: tempest-TestVolumeBootPattern-591009407 Jun 16 23:12:54.188662 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Role: member,reader Jun 16 23:12:54.188662 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Roles: member,reader Jun 16 23:12:54.190322 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/1423c05c42b14519b401e22e16062781"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_1423c05c42b14519b401e22e16062781"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1423c05c42b14519b401e22e16062781"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1423c05c42b14519b401e22e16062781"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}] Jun 16 23:12:54.190322 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Tenant: tempest-TestVolumeBootPattern-591009407 Jun 16 23:12:54.190322 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Tenant-Id: 1423c05c42b14519b401e22e16062781 Jun 16 23:12:54.190322 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-Tenant-Name: tempest-TestVolumeBootPattern-591009407 Jun 16 23:12:54.190322 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-User: tempest-TestVolumeBootPattern-591009407-project Jun 16 23:12:54.190322 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-User-Domain-Id: default Jun 16 23:12:54.190322 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-User-Domain-Name: Default Jun 16 23:12:54.190322 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-User-Id: 2697aa77265e4f5783f87ffb3d4992b5 Jun 16 23:12:54.190322 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: X-User-Name: tempest-TestVolumeBootPattern-591009407-project Jun 16 23:12:54.190322 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: method: > Jun 16 23:12:54.190322 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: exception: Instance bf5049e3-3446-468a-a334-d87825e50af4 could not be found. Jun 16 23:12:54.190322 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: action_args: {'id': 'bf5049e3-3446-468a-a334-d87825e50af4'} Jun 16 23:12:54.191473 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: {{(pid=117563) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 23:12:54.191473 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 23:12:54.191473 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 23:12:54.191473 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 23:12:54.191473 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 23:12:54.191473 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 23:12:54.191473 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 23:12:54.191473 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 23:12:54.191473 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 23:12:54.191473 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 23:12:54.191473 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf5049e3-3446-468a-a334-d87825e50af4 could not be found. Jun 16 23:12:54.191473 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 16 23:12:54.191473 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 23:12:54.191473 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 16 23:12:54.191473 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 23:12:54.191473 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 23:12:54.191473 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 23:12:54.191473 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 23:12:54.191473 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 23:12:54.191473 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 23:12:54.192936 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 23:12:54.192936 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 23:12:54.192936 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 23:12:54.192936 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 23:12:54.192936 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 23:12:54.192936 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 23:12:54.192936 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 23:12:54.192936 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf5049e3-3446-468a-a334-d87825e50af4 could not be found. Jun 16 23:12:54.192936 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 16 23:12:54.192936 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 23:12:54.192936 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 16 23:12:54.192936 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 23:12:54.192936 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 23:12:54.192936 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 23:12:54.192936 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 23:12:54.192936 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 23:12:54.192936 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf5049e3-3446-468a-a334-d87825e50af4 could not be found. Jun 16 23:12:54.192936 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: ERROR nova.api.openstack.wsgi Jun 16 23:12:54.194478 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: DEBUG nova.api.openstack.wsgi [None req-f31a36c3-0b10-453b-a366-9d95c523d147 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Returning 404 to user: Instance bf5049e3-3446-468a-a334-d87825e50af4 could not be found. {{(pid=117563) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 23:12:54.194478 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO nova.api.openstack.requestlog [None req-f31a36c3-0b10-453b-a366-9d95c523d147 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] 10.222.0.17 "GET /compute/v2.1/servers/bf5049e3-3446-468a-a334-d87825e50af4" status: 404 len: 111 microversion: 2.1 time: 0.028661 Jun 16 23:12:54.194478 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: [pid: 117563|app: 0|req: 557/1125] 10.222.0.17 () {58 vars in 1235 bytes} [Thu Jun 16 23:12:54 2022] GET /compute/v2.1/servers/bf5049e3-3446-468a-a334-d87825e50af4 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 23:12:55.474431 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: DEBUG nova.api.openstack.wsgi [None req-a8bcf518-109c-44fc-b6e1-45f74f8bb8b8 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] Calling method '.version_select at 0x7f5313eb4b80>' {{(pid=117562) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 23:12:55.494641 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO nova.api.openstack.requestlog [None req-a8bcf518-109c-44fc-b6e1-45f74f8bb8b8 tempest-TestVolumeBootPattern-591009407 tempest-TestVolumeBootPattern-591009407-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1351668635" status: 202 len: 0 microversion: 2.1 time: 0.024419 Jun 16 23:12:55.495322 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: [pid: 117562|app: 0|req: 569/1126] 10.222.0.17 () {58 vars in 1262 bytes} [Thu Jun 16 23:12:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1351668635 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 23:15:43.225569 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 23:15:43.226275 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Thu Jun 16 23:15:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 23:15:43.612635 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 23:15:43.612851 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Thu Jun 16 23:15:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 23:15:47.655971 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 23:15:47.656538 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Thu Jun 16 23:15:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 23:16:03.935773 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 23:16:03.936385 dv-cinder-846230-1-iscsi devstack@n-api.service[117562]: Thu Jun 16 23:16:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 23:16:07.479495 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 23:16:07.480000 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Thu Jun 16 23:16:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 23:16:07.625684 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 23:16:07.625899 dv-cinder-846230-1-iscsi devstack@n-api.service[117563]: Thu Jun 16 23:16:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!